Въведи своя e-mail и парола за вход, ако вече имаш създаден профил в DEV.BG/Jobs
Въведи своя e-mail и ще ти изпратим твоята парола
*The event will be in English.
This event is part of the AI/ML/Big Data User group.
AGENDA:
In the era of cloud-based data platforms, Azure Databricks is a leading solution for scalable data pipelines. However, ensuring data quality remains a challenge as data grows. Traditional frameworks rely on simple metrics like row counts, which miss subtle issues like distribution shifts or outliers.
This presentation introduces a statistically robust approach using CDFs (Change Data Feed) for Delta Lake Tables. CDFs enable proactive monitoring of data distributions, ensuring consistency across batch and streaming pipelines. By automating advanced data quality checks, organizations can build a comprehensive framework that scales with their data, improving reliability and detecting anomalies effectively.
>>> Q&A част
The event is free, but pre-registration is required.
USER GROUP: AI/ML/Big Data
The event is part of the AI/ML/Big Data User group. Every month we organize events on a topic related to AI/ML/Big Data. In order not to miss interesting information on the subject – subscribe.
ORGANIZED BY: DEV.BG is a specialized Job Board for IT jobs.
AI/ML/Big Data jobs: If you are looking for a job for AI/ML/Big Data, view the job listings here.
WHEN: April 7th, 07:30 pm.
Angela Ivanovska is an experienced Data Engineer with expertise in database development and data integration.
Angela has over 8 years of experience in the field of Data Engineering, where she developed a strong understanding of data architecture and ETL processes and data warehousing.
She has previously worked as a database developer and data integration engineer, and has improved her knowledge in data modeling, SQL programming and data analysis.
Currently, she uses her expert skills as a Data Engineer to design, develop and maintain scalable data pipelines, ensuring high data quality and integrity.
FactSet provides leading analytical services, content, and technology to help over 88,000 users discover and capitalize on opportunities.
Iris.ai is your best research assistant that uses NLP to find, extract and summarize key data from massive scientific databases.
Valtech is the experience innovation company that exists to unlock a better way to experience the world.