AWS Kinesis – Real-time data ingestion AWS Lambda – Serverless compute for data processing Amazon S3 – Raw and cleaned data lake storage AWS Glue – ETL jobs and schema mapping AWS Athena – SQL ...

This project builds a serverless batch data pipeline on AWS to analyze job market data using two public job APIs: Adzuna and Arbeitnow. It automates daily ingestion, transformation, and querying using ...