Dercio H.

Data Engineering Professional

GitHub | linkedIn | Mail

Sup! I am a full-stack developer that values reliability, ingenuity and scalability.

I’m passionate about optimizing processes and solving problems. I've built tools to monitor my own apps, automate deployments, bridge to Discord, and manipulate images. I’m currently learning more about Machine Learning and statistical analysis.

Some of my Projects

In no particular order...

Sorting 10K Images - Restore 10K Images - Image entry tool

What a mess! I was asked to come up with a solution to group, sort and label over 10,000 product images. I used a series of custom-trained machine learning models to classify each image using 16> different attributes.

To help speed up manual sorting, I wrote a script to check if the new file name matches a schema. Valid files got uploaded into a central product data database and bulk-renamed using the windows context menu for the script execution.

As this was going on, unfortunately flooding destroyed the on-site infrastructure that held all the images. To help them get pictures to clients, I created a temporary infrastructure that allowed them to download the images from a marketplace in a reasonable time frame.

• Python

• Apache Airflow to just run the image download processes and have them monitored

• MachineLearning

• C# for the windows application

Game Hosting as a Service

I made a service for my friends to allow them to host their own game servers. I used APIs from various cloud server providers to provision servers on-demand within a couple of minutes.

• Terraform & Ansible to spin up a machine and take care of the configuration.

• ASP.NET Core as a Backend Framework

• RabbitMQ provided communication between the different moving parts and offers scalability.

• C# for a Discord Bot to interface with the infrastructure. I decided to build a Discord bot originally. To give it a use community-wide and members to start games on the discord owners’ resources.

• vue.js as frontend

Automate the editing of >2k PDFs

Sometimes things don’t go to plan, especially when deploying to production on a Friday. In this case, a new system change incorrectly generated over 2000 invoices over the course of the weekend. Oops! I wrote a script to identify the incorrect invoices using OCR, edit each one as PDF in Photoshop, generate new text using Imagemagick, convert them back, then finally upload them to the backend. Around 10 files needed manual correction due to being edge cases.

• OCR

• Python

• Imagemagick

A Discord integration to an online store.

I built a custom bridge between a retailer's online store and their Discord. It was designed to work with the existing support ticketing system, deployed by another bot. My bot fetched details about each order with a slash command. This saved them a lot of time by preventing them from having to search for customers on their shop backend.

• C# for the Discord Bot

• ASP.NET Core as the Backend

• vue.js as frontend

About Me

I always question the status quo. When someone tells me “this is how we have always done it”, I look to see if improvements can be made - especially if my gut says “this can't be the final solution”.

I’ve already dipped my toe in many types of projects, from game development to leading a team of devs to building a live video streaming infrastructure. I’ve also worked hands-on as an event technician, building rigs and setting up lights, and live-mixing video from different camera feeds.

Call me a Swisskife of problem-solving.