EVZEsteban Vilca
EN
Connect on LinkedIn

Esteban Vilca.

Data engineering
& data science

CanadaEN · ES · PT

I turn complex data into systems people can rely on.

I build production data platforms and applied ML solutions, with experience in financial reporting, FX analysis and cryptocurrency time-series models, alongside multi-country data engineering for retail and industrial equipment.

Financial dataCrypto & time seriesRetail

Python · SQL · Snowflake · Spark
TensorFlow · PyTorch · Cloud & ML

Explore my workDownload CV (PDF)
Esteban Vilca, data engineer and data scientist

Finance, crypto & retail. Engineering grounded in business.

From source to decision

Orders
Products
ERP
SnowflakeSQL / dbt / Snowpark
Data qualityReconciliation / QA
Orders analyticsMulti-country data

Five countries. Production data.

As a Finning contractor through Squadric, I led orders-data migration to Snowflake across five countries and independently designed three country architectures.

Explore the Finning project
5countries
Transactions
FX data
Sales
AWSGlue / Athena / S3
GovernanceAnonymization / controls
Finance & leadershipCentralized reporting

Financial data, brought together.

At Vigil, I automated pipelines across three European countries, integrating financial datasets and replacing Excel- and email-based reporting.

Explore the Vigil project
~10,000operations / week
Cameras
Sensors
IoT
PythonTensorFlow / PyTorch
PrivacyAnonymization / edge AI
Healthcare researchEvent detection

Models that reach the real world.

At Semantix, I built pipelines and computer-vision workflows for healthcare research, deploying to NVIDIA Jetson and Raspberry Pi with privacy controls.

Explore my career
Edge AISemantix Brasil
Binance API
Market data
Social data
SnowflakePython / AWS / GCP
Time-series MLLSTM / CNN / GRU
Market analyticsPower BI / Tableau

Market data, models and analysis.

At Eyachay, I integrated cryptocurrency data, developed deep-learning models and built dashboards for financial analysis.

Explore my crypto experience
2019–21Eyachay

A conceptual map of my experience. Choose an area to explore.

EXPERIENCE ACROSS
Squadric
Vigil
amaris
semantix
Alura

Selected work03

Real production problems. Decisions I owned. Outcomes I can explain.

Finning · via SquadricSep 2025 — Present

Migrate orders data across five countries. Improve efficiency in production.

Finning distributes Caterpillar equipment and engines, parts and support services. I worked on the assignment as a contractor through Squadric.

As a Finning contractor through Squadric, led orders-data migration from Databricks to Snowflake across Canada, the UK, Argentina, Bolivia and Chile; independently designed three country architectures.

SnowflakedbtPythonAzureTerraform
Technical decisions & scope
  • Built and maintained approximately 25 production pipelines, with workloads from around 2 GB every 30 minutes to approximately 1 TB in weekly processing.
  • Implemented hash and row-count reconciliation, audit tables, automated QA, retries and Datadog monitoring.
  • Reduced one high-frequency pipeline from approximately 20 to 15 minutes, a 25% runtime improvement; provided technical guidance to two junior engineers.

Relevant capability: migration architecture, production validation and performance optimization.

US$60,000 · estimated annual savings. Annualized estimate based on three months of post-deployment operation.

Company context
One pipeline. A shorter runtime.
Before
~20 min
After
~15 min
−25%less runtime

Approximate execution times for one high-frequency pipeline at Squadric.

Estimated annual savingsUS$60,000

Annualized estimate based on three months of post-deployment operation.

VigilAug 2024 — Sep 2025

Replace fragmented financial reporting with automated, governed datasets.

The Vigil engagement brought together financial, transactional and FX data for Finance and executive reporting.

Designed and automated cloud data pipelines across three European countries, replacing Excel- and email-based reporting processes.

AWS GlueAthenaS3PythonSQL
Technical decisions & scope
  • Built daily pipelines supporting approximately 10,000 financial operations per week using AWS Glue, Athena, S3, Python and SQL.
  • Integrated financial, transactional and FX data for Finance and executive reporting, with anonymization and governance controls.
  • Analyzed FX performance and risk by trader to support assessment of profitability, execution quality and potential trading issues.

Relevant capability: financial data integration, reporting automation and governance.

Data behind the daily operation.
Financial dataAWS Glue / AthenaFinance & leadership
~10,000financial operations / week

Approximate volume supported by daily pipelines. Vigil.

Amaris ConsultingSep 2022 — Aug 2024

Deliver a scalable retail data platform and evaluate its business impact.

Amaris is a technology consulting firm. This engagement served a retail client with multi-country product, sales and operational data.

Designed and led a Databricks-to-GCP migration processing approximately 1 TB of multi-country product, sales and operational data.

PySparkBigQueryDataprocAirflowVertex AI
Technical decisions & scope
  • Developed production PySpark workloads on Dataproc and orchestrated ingestion, transformation and ML pipelines with Cloud Composer and Airflow.
  • Adapted physical partitioning to changing dataset characteristics and coordinated country-specific requirements within a common architecture.
  • A controlled store comparison demonstrated approximately 10% higher sales and around US$10K in additional monthly revenue after deployment.

Relevant capability: distributed processing, cloud architecture and business outcome validation.

Company context
A cloud foundation for retail.
Cloud Composer / Airflow
Dataproc / PySparkBigQuery
Google Cloud Storage

Databricks-to-GCP migration; approximately 1 TB of data.

+~10% salesControlled store comparison after deployment. Amaris Consulting.

Outcomes reported in my professional profile.

How I work

Define the problem. Make the controls explicit. Deliver and measure.

Define scope and acceptance

Agree on datasets, consumers, constraints and success criteria before making architectural decisions.

Build with validation

Plan reconciliation, automated QA, monitoring and failure handling alongside implementation. My production experience includes these controls.

Measure and improve

Review runtime, data quality and relevant business outcomes. Use evidence to prioritize the next improvement.

Tools, with a purpose

Data platforms

Snowflake · Databricks · dbt · Apache Spark · PySpark · BigQuery

Cloud & delivery

Azure · AWS · GCP · Airflow · Docker · Terraform · Azure DevOps

AI & machine learning

TensorFlow · PyTorch · Scikit-learn · NLP · LLMs · MLOps

Languages & practice

Python · SQL · Scala · JavaScript · Data quality · Data governance

Esteban Vilca, data engineer and data scientistEsteban Vilca
Canada / EN · ES · PT

Engineering depth.
Business context.

My retail and financial services experience spans production platforms, sensitive financial information and coordination across countries. An MSc in Computer Science and a Master of Management help me connect technical decisions with operational requirements. I also bring applied ML experience and technical teaching practice.

Education

PhD Candidate in Computer Science · Universidade de São Paulo · 2021–Present

Master of Management · Crandall University · 2023–2024

MSc, Computer Science · Universidade de São Paulo · 2019–2021

More education & certifications

Bachelor’s degree, Computer Science · Universidad Peruana de Ciencias Aplicadas · 2014–2018

UC Irvine · Data Science & Predictive Analytics / Innovation Management & Entrepreneurship · 2018

Certifications: SnowPro Associate: Platform Certification · Microsoft Certified: Azure Data Scientist Associate

Professional development: Ethereum Token Implementation (ERC-20) · School of Blockchain and Cryptocurrencies

Bitcoin & blockchain researchBitcoin transaction networks and cryptocurrency portfoliosProcedia Computer Science · 2023 · Peer-reviewed publication
English · Full professionalSpanish · Native / bilingualPortuguese · Full professional
Download full CV (PDF)

CV in English. Contact through LinkedIn.

A career connecting disciplines.

2021–2023Data Scientist InstructorAlura Latam

Developed four deep-learning and time-series courses; adapted technical content across Portuguese, Spanish and English.

Alura provides online technology education. This role focused on deep learning and time-series courses for international learners.

Goal: Make neural-network and time-series concepts usable through courses and live technical training.

Outcome: Designed and delivered four courses, reaching approximately 100 Spanish-language online students with an average learner rating of approximately 4.5/5.

2021–2022Data ScientistSemantix Brasil

Built IoT pipelines and computer-vision workflows with privacy controls for healthcare research.

Semantix is a data and AI company. The assignment supported a government research project monitoring elderly patients through camera, smartwatch and IoT information.

Goal: Process sensor and video data to detect health-related events while protecting sensitive information.

Outcome: Built streaming and batch pipelines and deployed AI workloads on NVIDIA Jetson and Raspberry Pi, with privacy-preserving processing.

2019–2021Data ScientistEyachay Software and Education

Built financial and cryptocurrency ML workflows, Snowflake datasets and analytical dashboards.

Crypto · Market data

Binance APISnowflakeLSTM · CNN · GRUPower BI · Tableau

At Eyachay, I developed time-series models for cryptocurrency datasets, integrated the Binance API, and connected financial data with Snowflake and analytical dashboards.

The documented projects used financial and cryptocurrency datasets for analytical and machine-learning workflows.

Goal: Collect market information, develop time-series models and make financial data available for analysis.

Outcome: Built LSTM, CNN and GRU models, integrated Binance market data, and delivered dashboards alongside Snowflake and cloud workflows.

2018–2019Full Stack DeveloperNotaria Vilca

Built internal sales, accounting and document-management platforms.

The documented work supported sales, accounting, employee administration and document management for a notarial business.

Goal: Provide internal applications, databases and reports for operational teams.

Outcome: Developed internal platforms, administered databases and managed GCP services for the business.

2017Android DeveloperBit Perfect Solutions SAC

Developed routing and financial mobile applications.

The assignment covered truck-route recommendations between coordinates and maintenance of a financial mobile application.

Goal: Implement mobile functionality for geographic routing and financial workflows.

Outcome: Developed the route-recommendation application and contributed to a financial app’s development and maintenance.

Retail, financial services, data platforms and applied AI.

What does your next data platform need to solve?

Connect on LinkedIn

All conversations through LinkedIn.