The Department of Computer Science and Engineering (CSE) at our college conducted a two-day hands-on workshop on “Data Engineering with AWS” exclusively for third-year CSE students from October 25th-26th, 2024. This workshop aimed to equip students with essential skills in cloud-based data management and analytics, crucial for today’s data engineering roles.

This impactful event is aligned with the latest industry demands and innovations. Their dedication to student development provided participants with valuable insights into AWS technologies and tools.

Workshop Overview and Highlights

The workshop encompassed a comprehensive curriculum over two days, with focused sessions on key AWS services:

• Day One:
• Amazon S3: Introduction to bucket creation, object uploading, versioning, replication, storage classes, lifecycle management, and event notifications using Simple Notification Service (SNS).
• Day Two:

• AWS IAM (Identity and Access Management): Configuring IAM users, groups, policies, and roles.
• AWS RDS (Relational Database Service): Connecting to MySQL databases.
• DynamoDB and Lambda Functions: Setting up DynamoDB and Lambda, including Lambda triggers via S3.
• AWS Athena and Glue: Querying data with Amazon Athena using a Netflix dataset and data transformation with AWS Glue, including CSV-to-JSON conversions and merging files.

Hands-On Learning and Practical Skills

Across both days, students engaged in interactive sessions, working with key AWS services, including Amazon S3 for data storage, AWS IAM for access management, AWS RDS and DynamoDB for database management, AWS Glue for data transformation, AWS Lambda for serverless operations, and Amazon Athena for data analysis. This comprehensive exposure allowed students to build secure, end-to-end data pipelines, covering data ingestion, transformation, warehousing, and analysis.

Through hands-on practice, students gained a solid foundation in AWS-based data engineering, honing skills aligned with current data-driven industry standards. The workshop empowered students with the technical proficiency needed to excel in data-centric roles, setting them on a trajectory for success in data-intensive environments.