Home > Insights > Pipeline Network Performance Using Machine Learning

Pipeline Network Performance Using Machine Learning

An extensive water pipeline network consisting of several interconnected pipelines supplies water to various pump stations. The system has been in place for many years and has experienced serious issues with corrosion/erosion and below-expected flow rate delivery at various points in the system. To help understand the potential causes, flow meters at various points were installed to gather data. Penspen’s scope was to develop a model of the network to enable the efficient assessment of the network performance. The work was executed by the Centre of Engineering Excellence (CEE).

Initial Assessments 

Initial data assessment of the flow meters suggested lower than expected flow, with at least one pipeline almost entirely blocked. The usual method is to develop a flow assurance model and perform simulations to assess the network performance. The challenge in undertaking performance analysis of this system is obtaining a complete set of input data in the form of boundary conditions for the 3 inputs and 9 outputs and dealing with the continuously changing conditions with start-ups and shutdowns of individual pump stations.

Machine Learning Overview 

As an alternative, the flow rate data already gathered was used to develop a machine learning model of the system. Use of machine learning algorithms to build a model of the system that predicts outputs based on inputs. Machine learning algorithms are used to build a model based on sample data, known as “training data”, to make predictions or decisions without being explicitly programmed to do so. The model was used on two datasets: before and after installation of additional equipment, with the former used as the training data and the latter as the test data. Air valves were installed and flow rate data before and after their installation was available. This approach allows for a significantly faster method to assess changes to the system to determine potential causes & also assess the impact of mitigation measures. Another benefit is that it does not need a full data set, though more data will increase the accuracy. This can be particularly advantageous where only incomplete input data is available, which can be the case with aging assets.

General Overview of the Workflow

Machine Learning Model

For this study Machine learning was performed using Orange software. Orange is a component-based visual programming software package for data visualization, machine learning, data mining, and data analysis. Visual programming is implemented through an interface in which workflows are created by linking predefined or user-designed widgets. A bespoke workflow was developed for this project – see figure below.

Orange machine learning network model with training data, comparative data, machine learning algorithms, tests, and predictions.

Model Testing

Model testing yielded good results. Individual plots of measured and predicted, and unity plots were created at each pump station location, an example is shown below.

Model testing: LEFT: individual predicted (red) vs. measured (blue). RIGHT: unit plots

Run with Test Data

The validated machine learning model was subsequently run with input data from the test dataset. The comparison of predicated and measure data points at a particular location are shown below.

Individual predictions (red) vs. measurements (blue)

Conclusion

The machine learning methodology proved to be an accurate and efficient method for comparing performance. It has the advantage of not needing a complete dataset and relatively straightforward to set up. This allows for fast evaluation of results to changes in inputs to identify trends to assess network performance. As more data is gathered over life, this can be added to augment the model and improve accuracy. The model maintenance requires minimal effort, yet provides a close.

This work was performed by Penspen’s Centre of Engineering Excellence (CEE), which provides advanced analytics and simulation services as one of their main offerings. To find out more information on the performance of pipelines and our capabilities at the CEE, email our Executive Vice President, Technical Excellence, Nigel Curson.

Insights & News

Image of cracking in a steel pipeline
Find Out More
05-03-2025 Insights

Demystifying Hydrogen Fatigue Crack Growth

With the increasing momentum to adopt clean fuels coupled with the scrutinised investment horizons of maintaining ageing gas pipelines, there are well-established and mutually beneficial...

Learn More
Head of Engineering Hydrogen
Find Out More
26-02-2025 Insights

Energy – the final frontier?

The transition from a career developing structures for use in space to solving the challenges of implementing hydrogen infrastructure may not seem straightforward, but for Penspen’s Head of...

Learn More
Find Out More
25-02-2025 Insights

What Are the Key Integrity Considerations When Repurposing Pipelines for Hydrogen?

With the European Hydrogen Backbone targeting 52,000 km of hydrogen pipelines by 2040 - 60% of which will be repurposed from existing infrastructure - ensuring the integrity of these pipelines will...

Learn More
Digital Pipeline
Find Out More
18-02-2025 Insights

Beyond Compliance: Optimisation Opportunities of the Gas Mega Rule – Pipeline Integrity Management with Digital Twins, Multiple Inspections, and Artificial Intelligence

In a new technical paper presented at the 2025 Pipeline Pigging and Integrity Management Conference, Penspen, Senslytics, and PipelineLogic explore how Penspen's THEIA platform and Causal AI...

Learn More
Find Out More
28-02-2025 News

Penspen Joins Hydrogen UK to Drive the Future of Clean Energy in the UK

International engineering consultancy reinforces commitment to sustainable energy by becoming an official member of the UK’s leading hydrogen trade association. Penspen, a leading international...

Learn More
Find Out More
29-01-2025 News

Penspen Reports $120 Million Worth of New Contract Awards Secured in Second Half of 2024

Company’s comprehensive engineering expertise helps improve energy access for communities worldwide Penspen today announces a positive finish to the fiscal year with $120 million awarded in new...

Learn More
Find Out More
16-01-2025 News

Penspen Shortlisted for 2025 Hydrogen UK Annual Awards

International engineering consultancy Penspen has been shortlisted as finalists at the 2025 Hydrogen UK Annual Awards. The Hydrogen UK Annual Conference and Awards is the premier event celebrating...

Learn More

More insights