Home > Insights > Pipeline Network Performance Using Machine Learning

Pipeline Network Performance Using Machine Learning

An extensive water pipeline network consisting of several interconnected pipelines supplies water to various pump stations. The system has been in place for many years and has experienced serious issues with corrosion/erosion and below-expected flow rate delivery at various points in the system. To help understand the potential causes, flow meters at various points were installed to gather data. Penspen’s scope was to develop a model of the network to enable the efficient assessment of the network performance. The work was executed by the Centre of Engineering Excellence (CEE).

Initial Assessments 

Initial data assessment of the flow meters suggested lower than expected flow, with at least one pipeline almost entirely blocked. The usual method is to develop a flow assurance model and perform simulations to assess the network performance. The challenge in undertaking performance analysis of this system is obtaining a complete set of input data in the form of boundary conditions for the 3 inputs and 9 outputs and dealing with the continuously changing conditions with start-ups and shutdowns of individual pump stations.

Machine Learning Overview 

As an alternative, the flow rate data already gathered was used to develop a machine learning model of the system. Use of machine learning algorithms to build a model of the system that predicts outputs based on inputs. Machine learning algorithms are used to build a model based on sample data, known as “training data”, to make predictions or decisions without being explicitly programmed to do so. The model was used on two datasets: before and after installation of additional equipment, with the former used as the training data and the latter as the test data. Air valves were installed and flow rate data before and after their installation was available. This approach allows for a significantly faster method to assess changes to the system to determine potential causes & also assess the impact of mitigation measures. Another benefit is that it does not need a full data set, though more data will increase the accuracy. This can be particularly advantageous where only incomplete input data is available, which can be the case with aging assets.

General Overview of the Workflow

Machine Learning Model

For this study Machine learning was performed using Orange software. Orange is a component-based visual programming software package for data visualization, machine learning, data mining, and data analysis. Visual programming is implemented through an interface in which workflows are created by linking predefined or user-designed widgets. A bespoke workflow was developed for this project – see figure below.

Orange machine learning network model with training data, comparative data, machine learning algorithms, tests, and predictions.

Model Testing

Model testing yielded good results. Individual plots of measured and predicted, and unity plots were created at each pump station location, an example is shown below.

Model testing: LEFT: individual predicted (red) vs. measured (blue). RIGHT: unit plots

Run with Test Data

The validated machine learning model was subsequently run with input data from the test dataset. The comparison of predicated and measure data points at a particular location are shown below.

Individual predictions (red) vs. measurements (blue)

Conclusion

The machine learning methodology proved to be an accurate and efficient method for comparing performance. It has the advantage of not needing a complete dataset and relatively straightforward to set up. This allows for fast evaluation of results to changes in inputs to identify trends to assess network performance. As more data is gathered over life, this can be added to augment the model and improve accuracy. The model maintenance requires minimal effort, yet provides a close.

This work was performed by Penspen’s Centre of Engineering Excellence (CEE), which provides advanced analytics and simulation services as one of their main offerings. To find out more information on the performance of pipelines and our capabilities at the CEE, email our Executive Vice President, Technical Excellence, Nigel Curson.

Insights & News

A banner for International Women in Engineering Day.
Find Out More
23-06-2025 Insights

International Women in Engineering Day: Meet April, Najma and Nora

In this second edition, meet April, As-Build Coordinator & Lead CAD Associate at C&I Engineering, a company acquired by Penspen in 2024; Najma, Senior Finance Officer based in Abu Dhabi; and Nora,...

Learn More
A banner introducing International Women in Engineering Day.
Find Out More
19-06-2025 Insights

International Women in Engineering Day: Meet Shobhina, Maria and Rachael

The energy industry is changing rapidly, and meeting the challenges posed by this transition requires a diversity of talent and perspectives – something that we’re committed to addressing in a...

Learn More
Image of technical paper being presented at Pipeline Technology Conference 2025
Find Out More
12-06-2025 Insights

Carbon Capture, Utilisation and Storage – What are the Real Challenges & Costs?

As the global push for net zero intensifies, Carbon Capture, Utilisation, and Storage (CCUS) is emerging as a critical technology to decarbonise energy supplies and industrial processes. With the...

Learn More
Image of two young males presenting at conference
Find Out More
03-06-2025 Insights

Challenges and Considerations for Hydrogen Integration in Natural Gas Pipeline Networks: A Comparative Screening Methodology

The global transition to hydrogen is accelerating, and repurposing existing natural gas pipelines is a critical step towards a low-carbon future. However, ensuring the feasibility, safety, and...

Learn More
Find Out More
30-06-2025 News

Penspen and Cosasco Announce Strategic Collaboration to Advance Corrosion Monitoring and Management Solutions

(L-R Brandon Alexander – Penspen US Director, Peter O’Sullivan – Penspen CEO, Philip Bourop  – Cosasco President, Om Mourya – Cosasco VP of Sales, Gustavo Romero...

Learn More
Two male technicians wearing a hard hat, safety glasses and hi-vis jacket are standing outside inspecting a piece of pipework.
Find Out More
25-06-2025 News

Penspen Training Courses Achieve IGEM Recognition

Penspen’s asset management training courses were recently recognised by IGEM, the Institution of Gas Engineers and Managers. This prestigious recognition demonstrates that Penspen’s...

Learn More
An external view of Penspen's new office in Aberdeen
Find Out More
26-05-2025 News

Penspen Strengthens North-East Commitment with New Aberdeen Office as Growth Accelerates

New Office Investment Boosts 200-Strong Team’s Capacity to Deliver Key Energy Transition Projects (Darren Bartlett, Penspen’s Director of EPM and Energy Transition and Grant Lunn, CEO of...

Learn More

More insights

Penspen
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.