Docker

Access Amazon S3 Tables from Local using Apache Spark Docker Container | Demo

Recently, Amazon S3 has introduced S3 Tables, a fully managed Apache Iceberg tables for storing tabular data at scale. It is specifically optimized for analytics workloads to deliver up to 3x faster query throughput and up to 10x higher transactions per second compared to self-managed tables (Iceber

22 Jan 2025 · 8 min read

Test and Debug AWS CodeBuild Builds Locally using AWS CodeBuild agent

If you are still using AWS CodeBuild managed service for testing and debugging, then you have the scope to save cost and expedite the build-test-debug cycle loop using AWS CodeBuild local agent. Troubleshooting and fixing issues in BuildSpec file is so easy on the local development machine. In this

17 Jul 2023 · 7 min read

AWS CodeBuild - GitHub Actions: COMMAND_EXECUTION_ERROR Message: Error while executing command | [error]Docker pull failed with exit code 1

For GitHub Docker container actions, "build project must have privileged mode enabled and be run by the default Docker user (root)."  Otherwise, build will fail with following error logs. [Container] 2023/07/11 02:09:11 Entering phase PRE_BUILD [Container] 2023/07/11 02:09:11 Preparing action comma

10 Jul 2023 · 2 min read

Fix: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?

Issue: sudo service docker start says "Starting Docker: docker" but sudo service docker status shows "Docker is not running" and most docker commands throw following message "Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?". abhijit@AwsJunkie:~$ sud

4 Feb 2023 · 3 min read

Install Docker Engine and Docker Compose on Windows Subsystem for Linux (WSL 2)

If you already have Docker Desktop installed or want to use docker on both Windows and WSL2, then Docker Desktop is better choice. But I personally prefer to install and run the "most-loved Tool" docker inside Windows Subsystem for Linux (WSL 2). This keeps the development environment isolated and t

3 Feb 2023 · 5 min read