Generated Insights from Large Data Set for Vision Care Industry

The Vision Council stands as a pioneering force within the vision care industry, driven by a steadfast commitment to enabling better vision for better lives. With a visionary mission to position its members for success through education, advocacy, research, and strategic relationship building, The Vision Council plays a pivotal role in shaping the landscape of vision care.

Upholding values of excellence, integrity, collaboration, and innovation, the organization serves as a beacon of reliability and innovation in an ever-evolving industry. With a rich history of industry leadership and a forward-thinking approach, Our client continues to spearhead initiatives that drive excellence and accessibility in vision care products and services, cementing its position as a trusted authority and catalyst for positive change within the optical community.

Problem Statement

The Vision Council encountered significant challenges in managing diverse data formats, coping with changing survey questions, and executing manual data processing. These inefficiencies resulted in errors, and delays, and hindered the extraction of timely insights for decision-making.

Our Efficient and Scalable solution

We specialize in developing custom solutions for data management challenges, including ETL processes.
With expertise in leveraging cloud-based technologies such as AWS Lambda and Snowflake, Blue Whale Apps can design and implement efficient and scalable solutions tailored to client’s needs.
Blue Whale Apps’ experience in integrating and optimizing data processing pipelines ensures smooth and reliable operations.
By prioritizing security and reliability, Blue Whale Apps ensures that data integrity is maintained throughout the process.
With a proven track record of successful implementations across various industries, including healthcare and technology, Blue Whale Apps is well-equipped to assist to our clients in transforming its data management operations.

Challenges Overcome

The team encountered challenges such as changing survey question formats, NA options, and evolving data structures over time.
AWS Lambda functions and Snowflake’s secure data warehouse effectively managed these complexities.
Evaluation of tools like FiveTran and DbT helped in selecting the most suitable options based on factors like pricing and maintenance costs.

Implementation Details

Multiple Lambda functions were developed to handle different aspects of data processing, including survey responses and procedural data.
These functions enabled efficient extraction, transformation, and loading of data, ensuring high-quality outputs.
Data was stored in Snowflake’s highly secure environment,with compression techniques for at rest data employed to optimize storage efficiency.

Tools and Technologies

AWS Lambda, Object Storage, IAM policies, DbT, FiveTran, Snowflake (stored procedures, tasks, storage integration, Stages, email integration), AWS Workemail, SQL procedures, Tasks

Outcomes Achieved

Ready-to-use data for analysis and presentation with minimal manual intervention.
Data quality improved significantly, reaching an accuracy rate of 99%.
Insights on demographics, eyewear preferences, and insurance trends became readily available.
Enabled data-driven decision-making within The Vision Council.

Got an idea? A vision?

We want to hear it.