ETP v1.2 builds on early deployments of ETP v1.1

Following the release of ETP v1.1 in 2016, some benchmarks and numerous operational implementations demonstrated the benefits of the new protocol, mostly in the realm of real-time drilling data transmittal from rig to centralized monitoring facilities. The quasi-absence of a lag time in transmittal (about 1 second compared to 10-15 seconds) was critical to successful monitoring. See the seminal World Oil article co-authored by Equinor, Kongsberg and Baker Hughes here. The reduction of transmitted volumes by a factor of 10 was useful to operations in remote locations using limited-bandwidth satellite communication systems. ETP v1.1 was also deployed by a few technology vendors to implement two-way data interoperability between different software platforms. The experience accrued during these 3 years indicated a strong potential for ETP to displace older protocols, if some shortcomings could be addressed and some new features were added to expand the scope of workflows supported by ETP. This led to the 2-year effort (2019 - 2021) to design, build and test ETP v1.2.

Summary of new / improved features in ETP v1.2

Reliability

Support was added to cover a broader range of use cases and increase reliability by avoiding data loss. Reliability highlights include:

• More robust data-streaming protocols, which include a “simple streamer” for WITS-like data transfers, and two new streaming protocols—one store-driven (to "pull" data) and one customer-driven (to "push" data)—to meet the various demands of real-time operations
• New workflows such as auto-startup at the rig site
• Improved operational efficiency and outage recovery with the exchange of timestamps from the store’s clock in several operations in various ETP sub-protocols. Endpoints can track these timestamps for about 24 hours for channel data and growing data object parts and can track it for even longer for data objects

Support of all data

New protocols and improved design expand the support of ETP v1.2 to all Energistics data models: WITSML™, RESQML™ and PRODML™. Protocol improvement highlights include:

• A re-designed shared Discovery protocol, based on data models as graphs, which makes it possible to discover quite precisely the content in a store in a single request, thereby reducing traffic on the wire
• The definition of high-level outage recovery and replication workflows for data objects, parts of growing data objects, and channel data. Reliability features make it possible to reliably replicate data and recover from unintended disconnects/outages with a significantly reduced likelihood of having to "resend all data again"—which of course is costly and time consuming. New features also support better decision making around when it is necessary to resend everything
• Provides all the functionality for WITSML v2.0 that was possible in WITSML v1.4.1.1, but with more efficiency and reliability
• New capabilities such as the DataArray protocol to transfer large, binary arrays of heterogeneous data values (e.g., for RESQML interpretation and modeling data and PRODML DAS data)
• New query capabilities for Discovery, Store and GrowingObject protocols, which use an OData-like syntax. These advanced query capabilities help support existing and new industry workflows

Security

Based on needs expressed by the Energistics community for improved security, the necessary changes to the design were made to address this very important concern. Security highlights include:

• A new design that still authorizes connections between ETP applications while leveraging relevant parts of existing security standards to provide increased security with minimum additional standard requirements
• This approach also allows developers to add custom enhanced functionality now, and for ETP to expand its functionality and requirements in the future

DevKit

Petrotechnical Data Systems (PDS) had contributed a development kit for v1.1, and followed up in 2020 with a prototype DevKit for the release candidate ETP v1.2 RC2. This is being finalized as an official version for ETP v1.2 and will be available for download on BitBucket soon. ETP DevKit information is here. A video was recorded to walk developers through the processes to use the DevKit, this will be generally applicable to the final v1.2 DevKit and it can be viewed here.

ETP v1.2 and the OSDU™ Data Platform

ETP is well-suited to applications that involve streaming data from outside repositories or live data acquisition systems to an OSDU Data Platform-compliant cloud-based system. It is being actively considered for that role.

More information on ETP

The ETP Users and Developers page Energistics University content, modules 15, 16 and 17 Go to Download Standards to download the package