Lately I have been using VS code dev containers quite a lot. I also use AWS pretty extensively. So when I started using dev containers and found that calls to AWS services are failing from my dev container, I looked for a solution. Here is how I solved it. On you local machine when you try to call aws services e.g. aws s3 ls - It fetches your credentials from ~/.
Continue ReadingAmazon Quicksight is an amazingly simple Business Intelligence tool that is fully managed and allows one to get started with dashboarding and reporting in a matter of minutes. Its dashboard embedding feature is allows you to embed the dashboards natively in your web applications. Essentially you have 3 steps to perform Assume an IAM role (Let’s call it quicksight-embedded) that has 2 required permissions: quicksight:RegisterUser quicksight:GetDashboardEmbedUrl For example you have your application running on an EC2 instance/Lambda/ECS Task that has the role myAppIAMRole .
Continue ReadingKinesis video streams is one of the easiest way to stream your videos to internet. We will try it today using a raspberry pi. I am using the below hardware for streaming video. Hardware that I will use: Raspberry pi - https://www.raspberrypi.org/products/raspberry-pi-4-model-b/ Camera module - https://www.amazon.com/gp/product/B07L82XBNM/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1 Steps: 1. On raspberry pi Enable camera by running below and selecting appropriate options raspi-config Install dependencies sudo apt-get install byacc flex sudo apt-get install cmake git clone https://github.
Continue ReadingAWS teams have built multiple workshops to help customers learn its services through self paced workshops. You can follow them at your own pacve and learn the cool stuff. These are hands on guides. Here is a list of the ones I have come through: Sagemaker workshop - https://sagemaker-workshop.com/ Yet another Sagemaker workshop - https://www.sagemakerworkshop.com/ Yet another Sagemaker workshop - https://www.getstartedonsagemaker.com/ Quicksight - https://embed-workshop.learnquicksight.online EKS - https://eksworkshop.com/ ECS - https://ecsworkshop.com/ EC2 spot - https://ec2spotworkshops.
Continue ReadingI did this session at AWS reinvent 2019. Keeping it here for reference. I also did a screen recording of the practice session before reinvent, details of which can be found at - https://github.com/prabhatsharma/ecommerce-microservices/blob/master/live-debugging.md
Continue ReadingWith AWS releasing myriad of services and features every week how do you even get to know what got released and what is relevant to you. On top of the new services/features getting released there are a lot of blogs that get released by AWS solution architects and engineers that provide useful instructions to achieve specific use cases. Imagine being able to get all the relevant details in your inbox automatically and is separate from your email that allows you to focus.
Continue ReadingLot of people run Kubernetes on AWS and need to use encrypted EBS volumes for security and compliace. I will lay down the steps below in order to use it. Create a storage class Create a PersistentVolume (or dynamically provisoned PersistentVolumeClaim) using the storage class Create a pod to use the PersistentVolumeClaim 1. Create a storage class You must create a storage class that can be used for creating a PV/PVC.
Continue ReadingEC2 i3 instances are great for scenarios where you require very high read/write performance as it provides you with locally attached instance store volumes upto 2 million read IOPS and 1.6 million write IOPS (for i3en.24xlarge). You can find details on available performance on these volumes at https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/storage-optimized-instances.html#i2-instances-diskperf . Many AWS customers use these instances for high IOPS sensitive applictions like databases. However instance store volumes are ephemeral. In order to ensure durability you need to be able to push the data on local SSD volumes to EBS on a regular basis.
Continue ReadingI use redshift occasionally for playing with some data. Its an amazing service(a datawarehousing solution) from AWS that you can use for analyzing large amounts of data. Every time I need to use redshift (every couple of months) I begin my search for a decent client that I can use. A google search does not result in something concrete right off with full of discussions on quora and other places.
Continue ReadingAmazon EKS user management You have setup the EKS cluster and are able to use it. Now you want your teammates to access to the cluster too, so that they can build and run the applications. User management for EKS is done via the aws-auth configmap in kube-system namespace. You can learn how to add users manually by modifying the aws-auth configmap using the official documentation which shows how to add users to EKS by editing the aws-auth configmap.
Continue ReadingNote: This blog provides a deep dive on EKS authentication. If your goal is to be able to just add/delete eks users then follow this eksuser-amazon-eks-user-management-tool When you create an EKS cluster it uses credentials of the user creating the cluster to set things up and assigns the user cluster-admin rights on the cluster through kubernetes RBAC. EKS uses IAM for authentication. It uses aws-iam-authenticator for authentication using webhook token authentication of kubernetes.
Continue Reading