Connecting Waterpeople
Premium content

The explosion of data validation: The great challenge of water digitalisation according to KISTERS

Stefano Vincenzo De Simone, KISTERS Operational Water & Urban Water Expert.
Content by:Ana López
Download PDF article
Download

As urban water utilities face mounting challenges, digital transformation has become essential. In this interview, Stefano Vincenzo De Simone, Operational Water Management Solution Area Manager at KISTERS, discusses the role of data validation in these shifts and how technologies like IoT, AI, and big data are reshaping water management.

KISTERS is a global leader in water, weather, and environmental data management solutions, known for its scalable platforms and instrumentation. With decades of experience and expertise in managing complex data ecosystems, KISTERS helps organisations worldwide improve operational efficiency, ensure compliance, and build resilient strategies in the face of growing climate pressures and urbanisation.

Published in SWM Print Edition 24 - November 2024
SWM Print Edition 24

What are the most significant drivers pushing urban water utilities toward digital transformation?

The way ICT has advanced so quickly has really driven down the cost of sensors, while making them a lot more reliable for measuring and transmitting data. This shift has opened the door to installing more sensors across the board, which means we're seeing an explosion in the amount of data being generated. On top of that, costs of IT infrastructure have dropped, making it easier to store and process all this data.

Digital transformation is essential for urban water utilities facing mounting challenges and rising customer expectations

Urban water utilities, which often operate with a mix of private ownership and public oversight, now face a double challenge. On one hand, they have to meet strict environmental regulations, and on the other, they need to boost operational efficiency to stay profitable. At the same time, they’re under pressure from rising customer expectations for reliable, high-quality water services. And with climate change adding in extreme weather events and growing water scarcity, there's an urgent need for water management strategies that are both resilient and adaptive.

Digital transformation really offers the tools utilities need to deal with these pressures. It allows them to optimise their performance, stay compliant with regulations, tackle climate challenges head-on, and manage water sustainably, all while serving growing urban populations.

How are new technologies like IoT, AI, and big data analytics reshaping the way water utilities manage their operations?

IoT devices have really changed the game in water management by allowing real-time monitoring of things like water levels, flow rates, temperature, pH etc. This makes it possible to quickly address issues like leaks or contamination as soon as they happen. But with all this technology comes a huge amount of data, which means you need strong storage and management solutions in place. That’s where companies like KISTERS come in — they use advanced analytics to make sense of the data, optimising operations by spotting patterns and predicting how the system will behave. Adding AI into the mix takes it even further, enabling predictive maintenance and smarter decision-making, which helps utilities use their resources more efficiently.

Urban water utilities must balance strict environmental regulations with the need for operational efficiency to remain profitable

With all this new data being generated, what kinds of challenges are utilities encountering when it comes to data quality?

No sensor system is flawless, and if you use raw data without proper validation, it can lead to bad decisions. Data validation is a big challenge for water utilities because it takes time and expertise, plus there are concerns around integrating all that data and keeping it secure. Without the right tools, there's a real risk of falling into the "garbage in, garbage out" trap. That’s where solutions like KISTERS' DataValidation Web Application come in — it makes the process easier, ensuring data quality and integration so utilities can stay focused on delivering reliable service and meeting regulatory requirements.

So what are some of those operational risks for water utilities if they fail to address data validation in their digital transformation efforts?

Without proper data validation, utilities are taking big operational risks. Basing decisions on bad data can mean skipping necessary maintenance, facing expensive equipment replacements, or missing system failures altogether — ultimately driving up costs. Not to mention, failing to meet strict regulatory standards can lead to legal trouble and financial penalties. Inaccurate data also puts public health at risk and can leave customers unhappy. On top of that, poor data quality makes it harder to make informed, strategic decisions, which can affect long-term infrastructure planning.

How does data validation fit into the broader process of ensuring operational excellence in water utilities?

IoT devices enable real-time monitoring of water levels, flow rates, temperature, and pH, allowing quick responses to issues

Data validation is key to running things smoothly because it ensures the information you’re using to make decisions is reliable. Effective validation processes, like the ones built into systems like KISTERS' WISKI Data Management System, have quality checks at every stage of data handling — from SCADA systems and operational logs to long-term storage. This kind of integration helps utilities streamline operations, make better use of resources, and improve service delivery. Plus, beyond just keeping things efficient, strong data validation supports strategic planning, keeps utilities compliant with regulations, and builds customer trust by ensuring the data is always accurate and reliable.

In your experience, what best practices should utilities follow to ensure their data is being validated and refined properly?

Ensuring proper data validation is all about balancing automated and manual processes, customised to fit the type of data, where it’s coming from, and how it's transmitted. The best approach combines automated validation tools with expert oversight to tackle different data quality issues. Utilities should work closely with software providers and data science experts to design and fine-tune their validation processes. Regular training and updates are also key to keeping up with changing data needs. Having a partner with deep expertise and advanced data management solutions, like KISTERS, can really help ensure high data quality and keep operations running smoothly.

KISTERS has a long history in environmental data management. How does this experience translate to addressing the needs of urban water utilities?

KISTERS' long experience in managing environmental data naturally led us to support urban water utilities as well. Our approach combines advanced software development with deep domain knowledge, which is why we offer solutions like WISKI and KISTERS Analytics — highly scalable systems built to handle massive data loads. Many of our team members are environmental and hydraulic engineers, so they truly understand the challenges of water management, making it an easy transition for us to serve urban utilities.

When it comes to data aggregation, water utilities often have similar needs to our environmental clients, but they also have unique requirements. These can include specific interfaces and processes, and we customise our solutions to fit those needs. While some companies provide open-source platforms, KISTERS delivers a comprehensive, commercial solution that’s reliable for customers who don’t want to spend time developing custom tools. With WISKI, we offer a quick-to-configure, out-of-the-box system that’s robust, allowing utilities to focus on operational excellence instead of software development.

Are there any specific case studies or examples from KISTERS’ environmental work that illustrate how your solutions can address the unique needs of urban water utilities?

Yes, we have a few great examples. One project that stands out is our work with VEOLIA (Keyhops), a big name in the water utilities sector. In this project, we focused on validating data streams from their legacy systems using our WISKI platform. What really made a difference for VEOLIA was WISKI’s scalability, which let them handle large amounts of data efficiently without losing performance. Plus, we integrated data from all kinds of formats and sources, which is something KISTERS has a lot of expertise in, making the transition to a modern data management system really smooth.

Data validation is a significant challenge for utilities, requiring time, expertise, and robust integration tools to avoid bad decisions

Another example is our collaboration with the Dirección General del Agua in Spain. With WISKI, we helped them centralise and validate data from a nationwide network of hydrometeorological, groundwater, channel, and reservoir monitoring stations. This system now plays a key role in Spain’s national water management platform, the Observatorio Nacional del Agua. Both of these projects show how KISTERS can meet the complex needs of urban water utilities, offering robust and scalable solutions that go beyond the capabilities of standard open-source platforms.

As utilities continue to invest in digital infrastructure, what emerging trends do you see in the way water data will be managed and utilised over the next 5-10 years?

One of the biggest trends will be the integration of AI into predictive and prescriptive analytics. This shift will pave the way for creating sophisticated models that need a lot of computational power, which is why cloud-based deployment is going to be so crucial. We’ll also see an increasing need for data sharing among industry players to effectively train these models, leading to the development of collaborative data ecosystems

How do you envision KISTERS evolving to meet the changing needs of urban water utilities as these digital trends take hold?

KISTERS has a strong track record of innovation and adaptability. We’re committed to continually integrating new technologies and maintaining our industry-leading product expertise. By combining data science with our domain knowledge, we’re in a great position to meet the evolving demands of urban water utilities and help them navigate the future of digital water management.

For utilities just starting on their digital transformation journey, what would be your key piece of advice regarding data management and validation?

For utilities at the beginning of their digital transformation journey, prioritising data quality is crucial. It’s important to start by working with data management experts to set up solid validation processes. Use advanced tools and systems that can effectively handle and refine data, even if it’s not perfect at first. Ensuring that your data is accurate and reliable is essential for making informed decisions and achieving operational excellence.