Serverless data lake centric analytics architecture

To compose the layers described in our logical architecture, AWS introduces a reference architecture that uses AWS serverless and managed services. In this approach, AWS services provide the following capabilities:

• Providing and managing scalable, resilient, secure, and cost-effective infrastructural components

• Ensuring infrastructural components natively integrate with each other

This reference architecture enables you to focus more time on rapidly building data and analytics pipelines. It significantly accelerates new data onboarding and driving insights from your data. The AWS serverless and managed components enable self-service across all data consumer roles by providing the following key benefits:

• Easy configuration-driven use

• Freedom from infrastructure management

• Pay-per-use pricing model

The following diagram illustrates this architecture.

AWS serverless data analytics pipeline reference architecture