Tech Briefs: Latest Trends in Data and AI
Keeping up with the latest advancements in research and development can be exhausting. Tech Briefs offer a solution by providing compact summaries of complex research and technological developments, giving readers quick insights into new methodologies, tools and innovations. These briefs are an essential resource for professionals, researchers and organisations who want to stay informed about the latest advancements that can drive progress in their fields.
The STELAR project is releasing a new series of Tech Briefs, showcasing notable developments in data management, artificial intelligence and smart agriculture. In this post, we will take a closer look at two of the most recent briefs, focusing on innovative approaches to data profiling and time series imputation.
Athena Research Center: Leading Data Discovery and Quality Management
The first in the series presents two Tech Briefs written by Athena Research Center (ARC). As the project coordinator, ARC leads the work in data discovery and quality management. They are responsible for designing the architecture and developing the data catalog, knowledge graph and data profiling tools, in close collaboration with The National and Kapodistrian University of Athens, Eindhoven University of Technology, and Altair RapidMiner. These initial briefs highlight their work on data profiling and time series imputation.
Tech Brief #1: TableSage – Tabular Data Profiling with Large Language Models
Written by Alexandros Zeakis, PhD Candidate at Athena Research Center, this Tech Brief introduces an innovative approach to tabular data profiling using large language models (LLMs). Traditional data profiling involves manually analysing datasets to identify patterns, errors and opportunities for improvement. However, with the rise of LLMs, the process is becoming much more efficient and automated.
TableSage, the tool explored in this brief, uses LLMs to analyse tabular data, detect anomalies and generate insights. This AI-driven approach drastically reduces the time and effort required to assess data quality, enabling organisations to quickly identify issues and gain deeper insights into their datasets. Leveraging the power of AI, TableSage enhances the accuracy and reliability of data profiling, allowing data professionals to make better-informed decisions faster.
This brief highlights how the integration of LLMs into the data profiling process can streamline workflows and provide a more comprehensive understanding of complex datasets, particularly when dealing with large-scale data systems.
Tech Brief #2: Imputing Missing Values in Time Series
George Marinos, Machine Learning Research Engineer at Athena Research Center, explores a vital aspect of data analysis: imputing missing values in time series. In fields like agriculture and environmental monitoring, where data is continuously collected over time, gaps in datasets are common and can hinder accurate analysis.
Imputing missing values in time series data requires specialised techniques that account for the temporal relationships between data points. This brief explores advanced methods for accurately predicting and filling in missing values by using historical data trends and machine learning models. By addressing gaps in time series data, these techniques ensure that analyses remain reliable and predictive models can continue to function smoothly.
This Tech Brief is especially valuable for those working with time series data in agriculture, climate studies or any domain that relies on continuous, time-sensitive data. The ability to handle missing values without compromising the integrity of the dataset is essential for many data-driven applications.
Conclusion
STELAR is committed to advancing the field of data management and AI through the release of these insightful Tech Briefs. Focusing on innovative tools and techniques like TableSage and time series imputation, we are equipping professionals with the knowledge and tools to address some of the most pressing challenges in data analysis.
Keep an eye out for more briefs in this series, where we share insights on advancements shaping agriculture and beyond. Follow us on LinkedIn, Instagram, Facebook, and X to stay updated!
