A hybrid FUSE-based file system that spans between SSD and S3 to provide best of both worlds: fast access of SSD and unlimited storage of cloud. Implemented features like de-duplication, caching and ability to take snapshots.
Designed a distributed file system with multiple storage servers and a single naming server. Utilized RESTful APIs to support file operations like read, write, create, delete and file metadata queries. Developed a locking mechanism for concurrent access and replication to enhance fault tolerance.
Translates logical addresses into physical addresses on the flash, performs garbage collection of invalid blocks and incorporates block wear leveling to prolong the life of the SSD.
A RAFT-based distributed consensus algorithm in Golang for replicating log entries among a group of nodes to ensure fault-tolerance. Implemented mechanisms for heartbeats, leader election, voting, appending log entities, and backtracking during conflicts between leader and followers.
A RESTful service on EKS and with data on AWS RDS to find interaction score between two users and most used phrases on Twitter. Implemented horizontal scaling, connection pooling, and concurrency for maximizing RPS.