DevOps Articles

New — Amazon Athena for Apache Spark

https://aws.amazon.com/polly/ When Jeff Barr first https://aws.amazon.com/blogs/aws/amazon-athena-interactive-sql-queries-for-data-in-amazon-s3/ in 2016, it changed my perspective on interacting with data. To facilitate complex data analysis, organizations adopted https://aws.amazon.com/big-data/what-is-spark/.

With this feature, we can run Apache Spark workloads, use Jupyter Notebook as the interface to perform data processing on Athena, and programmatically interact with Spark applications using Athena APIs.

In this Jupyter notebook, customers can query data from various sources and perform multiple calculations and data visualizations using Spark applications without context switching.

Get Started with Amazon Athena for Apache Spark Let’s see how we can use Amazon Athena for Apache Spark.