S3 Batch Operations - Lambda
A brief guide outlining the process of setting up and running S3 Batch Operations Jobs with Lambda integration
Archive
2023
Exploring Pytest Fixtures: Notes and Examples
Here are some notes and real-world examples that I’ve gathered along the way, illustrating the use of pytest fixtures to enhance your architectural decisions for your testing module.
Fine-Tuning Glue Export File Size for Athena Queries
Exploring ways of configuring AWS Glue output file size and merging small files in post-processing stage for efficient Athena queries.
Exploring AWS CloudWatch Alarms
Exploring how AWS CloudWatch alarms work, how to define them in a CDK application, and how to work with periods, evaluation ranges, and missing data.
Personal Project - Automating numerical calculations and implementing ML models
The goal of this project is to create a system that allows scientists to automate numerical calculations and easily integrate ML models for numerical predictions
Authentication and Authorization in FARM Stack using JWT
Implementing authentication in FARM stack - FastAPI, React, and MongoDB - Using JSON Web Token (JWT).
2022
Local Python Development Environment
A guide explaining how to set up your local machine for Python projects and overview of most common tools used during development
Building OpenMPI, BLAS, LAPACK, ScaLAPACK, NetCDF, Flook, and SIESTA
Understanding libraries and building OpenMPI, BLAS, LAPACK, ScaLAPACK, NetCDF, Flook, and SIESTA with TBTrans and other utilities from source.
AWS Data Analytics Specialty Exam Experience and Study Notes
Sharing my AWS Data Analytics Specialty exam experience, resources, tricks and tips, study notes etc.
PGAS and Coarray Fortran
Exploring PGAS paradigm and playing around with coarrays in Fortran
Understanding systemd and creating Linux services
Learning about the basics of systemd, dependencies, unit files, service configuration, and how to set up custom applications as systemd services
Dynamic generation of multiple CI/CD parent-child pipelines using GitLab
Setting up GitLab CI/CD locally and exploring ways of generating nested parent-child pipelines
SageMaker Serverless Inference using BYOC
Methods of deploying custom models inside Docker images using the SageMaker and serverless inference
Understanding Big Data File Formats
Exploring the structure of popular Big Data file formats
DynamoDB Stream, Lambda, and S3 - Local Setup
A simple application that implements DynamoDB Stream, Lambda, and S3 services in a local setup
Achieving Scalable Multilingual Semantic Search
Basics of seq2seq architecture, ANNs, multilingual model, and how to use them to achieve scalable multilingual semantic search
DICOM File Processing
Using DICOM open source libraries to process DICOM files
2021
DICOM File Format Basics
Introduction to the DICOM file format