#55 Serverless ETL with Athena and Airflow | Builder's Diary Vol. 2
10/19/22 • 50 min
Get insights into the day-to-day challenges of builders. In this issue, Peter Reitz from our partner tecRacer talks about how to build Serverless ETL pipelines with Athena and Airflow. Learn how to extract data from data stored on S3, transform and enrich the data, transform it into a format optimized for data analytics and upload the data to S3 for further processing.
Would you like to join Peters's team to solve real-world problems with the help of data analytics and machine learning powered by AWS? tecRacer is hiring a Cloud Consultant focusing on Machine Learning and Data Analytics. Apply now!
Get insights into the day-to-day challenges of builders. In this issue, Peter Reitz from our partner tecRacer talks about how to build Serverless ETL pipelines with Athena and Airflow. Learn how to extract data from data stored on S3, transform and enrich the data, transform it into a format optimized for data analytics and upload the data to S3 for further processing.
Would you like to join Peters's team to solve real-world problems with the help of data analytics and machine learning powered by AWS? tecRacer is hiring a Cloud Consultant focusing on Machine Learning and Data Analytics. Apply now!
Previous Episode
#54 [Hot off the Cloud] Lambda event filtering Kafka + Athena query engine v3 + more
Weekly show about all things AWS by Andreas and Michael Wittig
Two brothers discussing all things AWS every week. Hosted by Andreas and Michael Wittig presented by cloudonaut.
- AWS News: Our thoughts on AWS's recent announcement.
- Lessons Learned: What we learned while building on AWS.
- #askcloudonaut: Ask us anything. Use the chat during the live stream or send in your questions in advance.
Looking for a new job?
Support us!
Our work on cloudonaut is possible only because of your support. Therefore, we want to thank our supporters! With your help, we can continue to produce independent & high-quality content focused on AWS. If you are not already doing so, please consider supporting us with a one-time or recurring donation as well. https://cloudonaut.io/support-us/
Next Episode
#56 [Hot off the Cloud] Lambda Parameters + Dark Mode + SQS FIFO + Nitro Enclaves + Interactive Video Service
Weekly show about all things AWS by Andreas and Michael Wittig
Two brothers discussing all things AWS every week. Hosted by Andreas and Michael Wittig presented by cloudonaut.
- AWS News: Our thoughts on AWS's recent announcement.
- Lessons Learned: What we learned while building on AWS.
- #askcloudonaut: Ask us anything. Use the chat during the live stream or send in your questions in advance.
Links
- Serverless ETL (Builder's Diary)
- AWS User Group Stuttgart
- AWS User Groups
- Amazon SQS announces increased throughput quota for FIFO High Throughput (HT) mode to up to 6,000 Transactions Per Second (TPS)
- Announcing AWS Parameters and Secrets Lambda Extension
- Amazon Interactive Video Service now includes web and mobile SDKs for IVS stream chat
- IAM Identity Center adds session management features for improved user experience and cloud security
- Announcing dark mode support in the AWS Management Console
- AWS Nitro Enclaves is now supported on AWS Graviton
- GitHub action to deploy CloudFormation stacks
Looking for a new job?
Support us!
Our work on cloudonaut is possible only because of your support. Therefore, we want to thank our supporters! With your help, we can continue to produce independent & high-quality content focused on AWS. If you are not already doing so, please consider supporting us with a one-time or recurring donation as well. https://cloudonaut.io/support-us/
If you like this episode you’ll love
Episode Comments
Generate a badge
Get a badge for your website that links back to this episode
<a href="https://goodpods.com/podcasts/cloudonaut-410630/55-serverless-etl-with-athena-and-airflow-builders-diary-vol-2-57287983"> <img src="https://storage.googleapis.com/goodpods-images-bucket/badges/generic-badge-1.svg" alt="listen to #55 serverless etl with athena and airflow | builder's diary vol. 2 on goodpods" style="width: 225px" /> </a>
Copy