Sergey Vareyko

Solution Architect | AI Platforms | Self-Hosted LLM & Distributed Systems

Summary

Software Architect and AI Infrastructure Engineer with 13+ years of experience building high-performance distributed systems and recent hands-on experience with self-hosted LLM infrastructure, GPU-based inference, and AI platform integration. Designs and operates local LLM environments, evaluates open-weight models, and integrates self-hosted inference with cloud AI providers. Focuses on model deployment, resource utilization, routing strategies, service reliability, and practical infrastructure trade-offs. Combines Java/Spring backend engineering, asynchronous processing, cloud infrastructure, and performance optimization with experience building multi-provider AI applications and distributed computational workloads.

Work Experience

Head of Java Department / Solution Architect iTechArt / Vention
  • Led architecture and technical delivery across 8+ enterprise projects, designing reliable distributed systems and production-oriented backend infrastructure.
  • Designed scalable service architectures with asynchronous processing, integration layers, performance optimization, and operational reliability requirements.
  • Established engineering standards, architecture reviews, and development practices, improving delivery efficiency by approximately 25%.
  • Provided technical leadership for a Java engineering department that grew from 15 to 45+ engineers, supporting mentoring, recruitment, and technical development.
  • Drove technical presales and architecture proposals, contributing to 4 successful enterprise client engagements.
Senior Software Engineer Itransition Group
  • Designed high-performance data access and search architectures combining Elasticsearch/Solr-style indexing with relational database queries, improving critical query performance by up to 90%.
  • Engineered reusable components for a distributed, multi-tenant SaaS platform, including cross-service communication, shared date/time processing, and high-performance document generation.
  • Contributed to architectural decisions, application performance improvements, and technical mentoring for 5+ developers.
Software Engineer (previously Support Engineer) TouchCommerce, Inc
  • Designed and implemented a reusable business rules framework supporting configuration and validation across 90+ enterprise client environments.
  • Automated approximately 80% of recurring support operations, reducing average ticket resolution time by 60%.
  • Developed backend services and real-time communication functionality for a large-scale customer engagement platform.

Selected Projects

Blog Writer — AI-Powered Content Automation Platform
Self-hosted, multi-provider AI platform that transforms real business content from social media into SEO-optimized articles. Automates multimodal content analysis, fact-checking, editorial workflows, and CMS publishing, significantly reducing manual content production effort.

Java 21, Spring Boot 4.1, MongoDB, Anthropic API, OpenAI API, Google Gemini API, TDLib, Instagram Graph API, Bitrix, ffmpeg

https://blogwriter.smart-automation.by/
Soundful
AI-powered music generation platform for creating original, professional-quality tracks. Designed and developed its distributed audio rendering engine, implementing parallel processing, custom DSP algorithms, intelligent sample-based synthesis, and automated mixing and mastering.

Java 17, Spring Boot 2.7, TarsosDSP, DSP, FFT, Rubber Band (C++/JNI), FFmpeg, AWS SQS, AWS S3, AWS ECS

https://soundful.com/
Smart Backups
Self-hosted backup cloud that lets applications publish backups via secure single-use links, while a coordinating server schedules delivery to private storage under configurable retention policies. Files transfer directly between application and storage host with integrity checks, resumable transfers and application-held encryption keys; restores run in one click.

Distributed Storage, Backup Automation, Resumable Transfers, Data Integrity Verification, Secure File Transfer, Java 21, Spring Boot 4, Spring Security, Spring Data MongoDB, MongoDB, Thymeleaf, Bootstrap, WebSocket, Maven, AES-256-GCM

https://backups.vareyko.com/
Vrtly
Digital signage and AdTech platform transforming screens in healthcare practices into patient engagement and advertising channels. Led platform architecture and engineering delivery, enabling scalable content distribution, automated campaigns, and centralized management of connected devices.

Java 17, Spring Boot, Spring Cloud, Spring Security, Angular, TypeScript, MySQL, Elasticsearch, Docker, AWS

https://vrtly.ai/
Panaseer — Enterprise Cybersecurity Controls Monitoring Platform
Continuous Controls Monitoring platform that consolidates data from fragmented security, IT and business systems to measure control effectiveness, expose coverage gaps and prioritise remediation by business risk. Contributed to the initial architecture and technology selection behind its scalable data collection and correlation pipelines.

Java 8, Spring, spring-core, spring-messaging, spring-security, spring-boot, Apache NiFi, Apache Kafka, REST, Angular 7, TypeScript, Angular Material, SockJS, JSON, JPA, Hibernate, MySQL, Phoenix, Git, Maven, JUnit, Mockito, Karma, Docker, Kubernetes, AWS, ServiceNow API

https://panaseer.com/

Technical Skills

LLM Infrastructure & Inference: Self-Hosted LLMs, Ollama, GPU-Based Inference, Open-Weight Models, Model Deployment, Model Evaluation, Context & Memory Management, Inference Performance Analysis
AI Platform Engineering: Multi-Provider LLM Integration, Model Routing, Provider Fallback, OpenAI-Compatible APIs, AI Workflow Orchestration, Multimodal Processing, Automated Validation
Distributed Systems & Performance: Distributed Systems, Asynchronous Processing, Event-Driven Architecture, Message Queues, Caching, Resource Optimization, Performance Profiling, Fault Tolerance
Backend Engineering: Java, Kotlin, Spring Boot, Spring Cloud, Spring Security, REST APIs, Python, GraphQL
Infrastructure & DevOps: Linux, Docker, WSL2, NVIDIA CUDA, AWS, Azure, Kubernetes, CI/CD, GitHub Actions, Monitoring & Observability
Data & Messaging: MongoDB, PostgreSQL, Elasticsearch, Redis, Apache Kafka, RabbitMQ, Amazon SQS

Education

Master's degree in Computer Systems and Networks Belarusian State University of Informatics and Radioelectronics (BSUIR)