Tag: AWS

All the articles with the tag "AWS".

• Tracking S3 file changes with ETags and LastModified

  16 Sep, 2024 · Updated 15 Oct, 2026

  Detect changed S3 objects without versioning: read ETag and LastModified with boto3, export an ETag CSV per date prefix, and handle multipart ETags.

• S3 Eventual Consistency Edge Cases in Data Pipelines

  8 Oct, 2026

  S3 has been strongly consistent since 2020. The edge cases that still break data pipelines: no atomic rename, concurrent writers, LastModified, events.

• How to Get the Status of an AWS Glue Workflow Using boto3

  30 Sep, 2026

  A Glue workflow can report COMPLETED while its jobs failed. How to poll workflow runs with boto3 and read per-node status from the run graph.

• AWS Glue Job Fails Due to Dependency Version Conflict: How to Fix It

  29 Sep, 2026

  Your Glue job works locally but fails with ImportError or numpy binary incompatibility. Why it happens and how to pin dependencies against the Glue runtime.

• Triggering AWS Glue Jobs from EventBridge: Workflows, Scheduler, and the IAM You Actually Need

  28 Sep, 2026

  A Glue job isn't a native EventBridge rule target. Three working patterns (workflow, Scheduler, Step Functions) with the exact IAM each one needs.

• Debugging AWS Glue Job Bookmarks Not Working as Expected

  27 Sep, 2026

  Glue job bookmarks fail silently: reprocessed data, skipped files, or no state at all. A checklist of the root causes and how to verify each one.

• Why Athena Returns No Rows on Partitioned Tables (and How to Fix It)

  26 Sep, 2026

  Your data is in S3, the table exists, and Athena returns zero rows. Six root causes behind partition metadata desync and how to diagnose each one.

• Why Terraform Does Not Deploy Your Lambda Container Image

  24 Apr, 2026

  When teams start packaging AWS Lambda functions as container images, a common misunderstanding appears quickly: “I created the Lambda with Terraform, so why is AWS saying the image does not exist?”