Data Science Digest - 28th March 2025

Amazon data scientists on efficient training of Large Language Models, Microsoft Fabric reveals new virtualization options, PostgreSQL Autobase 2.2.0 released, and Data Science Jobs at Meritus, Brainhunter Systems, Luxoft and more.

March 28, 2025

Data Science news around the web

Amazon Science - Training large language models more efficiently

“Training separate models on different datasets and then merging them reduces computational costs by as much as 91%… Large language models (LLMs) go through several stages of training on mixed datasets with different distributions, stages that include pretraining, instruction tuning, and reinforcement learning from human feedback. Finding the optimal mix of data distributions across datasets is essential to building accurate models, but it typically requires training and evaluating the model numerous times on a very large set of combinations.”

www.amazon.science/blog/training-large-language-models-more-efficiently

Microsoft Fabric - “Virtualize your Cloudera/Hadoop data estate into Fabric OneLake with Apache Ozone'“

“Microsoft Fabric OneLake shortcuts facilitate the virtualization of data from various cloud object stores and on-premises environments. For on-premises sources like Cloudera/Apache Ozone, the OneLake S3 Compatible Shortcut can be utilized to connect to these data sources. With OneLake Shortcuts, users can create a virtual reference to their Cloudera cluster data without moving or duplicating the data.”

blog.fabric.microsoft.com/en-AU/blog/virtualize-your-cloudera-hadoop-apache-ozone

PostgreSQL - Autobase 2.2.0 released

“We’re excited to announce the release of Autobase 2.2.0… Autobase for PostgreSQL® is an open-source alternative to cloud-managed databases (DBaaS) like Amazon RDS, Google Cloud SQL, and Azure Database. It enables you to deploy and manage production-grade, highly available PostgreSQL clusters with ease. Autobase simplifies operations, reduces infrastructure costs, and brings powerful automation to teams — even those without deep DBA expertise.”

www.postgresql.org/about/news/autobase-220-released-3045

Data science jobs

Meritus - Lead Data Engineer
London Area, United Kingdom, United Kingdom
< Python, Cloud, Azure, GCP, AWS >

Meritus - Data Team Lead
London Area, United Kingdom, United Kingdom
< Python, Cloud, Azure, GCP, AWS >

Gravitas Recruitment Group (Global) Ltd - Software Engineer
Salford, England, United Kingdom
< AWS >

Areti Group | B Corp™ - Quantitative Developer
United Kingdom, None, United Kingdom
< Cpp >

2N Future Tech - Senior AI/ML Developer
United Kingdom, None, United Kingdom
< Python, Cloud, Azure, GCP, AWS, ML, AI >

Information Tech Consultants - Junior Data Engineer
Greater London, England, United Kingdom
< Cpp, Python >

Collabera - Senior Consultant AI Advanced Analytics Operations
Toronto, ON, Canada
< Cloud, Azure, GCP, AWS, AI >

Brainhunter Systems Ltd - Data Engineer
Victoria, BC, Canada
< Python, AWS >

Synechron - Python Developer
Mississauga, ON, Canada
< Python, Crypto, Cloud, ML >

Alquemy Search & Consulting - Data Engineer
Vancouver, BC, Canada
< Python, Cloud, GCP, AWS >

BrainWave Professionals - AI/ML Engineer
Canada, None, Canada
< Cpp, Python, Cloud, Azure, GCP, AWS, ML, AI >

Atlantis IT Group - Senior Java Software Engineer
Montreal, QC, Canada
< UI >

Luxoft - Senior Big Data Developer
Mississauga, ON, Canada
< Python >

Luxoft - Big Data Developer
Canada, None, Canada
< Python >

Synechron - MSBI Sr. Developer
mississauga, on, Canada
< Crypto, Cloud, Azure >

EY FABERNOVEL - Data Engineer (Scala/Spark) - F/H
Paris, Île-de-France, France
< Cloud, Azure, GCP, AWS >

PROXIAD - Data Engineer
Lyon, Auvergne-Rhône-Alpes, France
< Python, Cloud, GCP >

EFOR - Senior Data Engineer/Architect H/F
Levallois-Perret, Île-de-France, France
< Python, Cloud, Azure >

Tata Consultancy Services - Stage Data Engineer sur GCP- Suresnes (H/F)
Paris, Île-de-France, France
< Python, Cloud, GCP, ML, AI >

eXalt Value - Data Engineer
Paris, Île-de-France, France
< Python, Cloud, Azure, GCP, AWS >

ALTEN Nederland - Software Architect
Eindhoven, North Brabant, Netherlands
< Cpp, Python >

NAVARA - Data Engineer
Zeist, Utrecht, Netherlands
< Python, Cloud, Azure, AWS, ML >

Hot ITem Conclusion - Data Architect
The Randstad, Netherlands, Netherlands
< Cloud, Azure, AWS >