Date   

cross-model comparison and reference architectures (was: Ongoing work on API specifications)

Robbie Morrison
 

Hi all

I am going to pass on the original question and instead change the subject to policy‑oriented modeling that I sometimes raise.  Four modeling frameworks recently ran a very simplified cross‑model comparison in the US (PDF attached as per scientific research):

  • Henry, Candise L, Hadi Eshraghi, Oleg Lugovoy, Michael B Waite, Joseph F DeCarolis, David J Farnham, Tyler H Ruggles, Rebecca AM Peer, Yuezi Wu, Anderson de Queiroz, Vladimir Potashnikov, Vijay Modi, and Ken Caldeira (15 December 2021). "Promoting reproducibility and increased collaboration in electric sector capacity expansion models with community benchmarking and intercomparison efforts". Applied Energy. 304: 117745. ISSN 0306-2619. doi:10.1016/j.apenergy.2021.117745.  Closed access.

Simple means one single node and no power flow in sight!  But this does represent a start in a public policy context.

Also to note that Renewables Grid Initiative (RGI) and Hitachi Energy (HE) have begun a collaboration on exactly that style of modeling.  The first such model outside of academia, government consortia, or NGOs that I know of.

Also of interest perhaps is a recent US supreme court decision in the context of the United States that refused to adjudicate on whether APIs attracted copyright but opined that if they did, that fair use would apply:

So I guess the question then arises as to the licensing on the APIs under discussion?  MIT perhaps?

Noting too that there would be a case for exposing this set of APIs more widely — and perhaps even to the public if security considerations allow — under statutory reporting considerations.

Finally, could EPRI Ireland email me offlist?  I tried really hard to find contact emails on the web but failed.  I am interested in the reference architecture being developed in the context of the kind of modeling above. TIA!

And sorry to Markus for forking his original posting, Robbie

On 11/02/2022 11.46, Markus Mirz wrote:
Hi,

as discussed in the last TAC meeting, one deliverable of the DAWG could be a set of generic (not implementation specific) API specifications for applications like simulation, state-estimation and forecasting.
The idea is to bring different LFE projects together on API level and make it easy for users to switch between implementations. For example, users can adopt the LFE simulation API in their tooling first and then compare different implementations available in LFE to understand better which one is the most suitable one for their application.

We (SOGNO, OpenSTEF) are working on a first example related to forecasting. It will be based on Alliander's OpenSTEF API. Let me know if you are interested in contributing to this effort.
When this is ready, I would like to organize another DAWG meeting to discuss the outcome.

This is just to keep you informed about what is happening even though we do not have regular DAWG meetings currently.

Cheers
Markus
-- 
Robbie Morrison
Address: Schillerstrasse 85, 10627 Berlin, Germany
Phone: +49.30.612-87617


Ongoing work on API specifications

Markus Mirz
 

Hi,

as discussed in the last TAC meeting, one deliverable of the DAWG could be a set of generic (not implementation specific) API specifications for applications like simulation, state-estimation and forecasting.
The idea is to bring different LFE projects together on API level and make it easy for users to switch between implementations. For example, users can adopt the LFE simulation API in their tooling first and then compare different implementations available in LFE to understand better which one is the most suitable one for their application.

We (SOGNO, OpenSTEF) are working on a first example related to forecasting. It will be based on Alliander's OpenSTEF API. Let me know if you are interested in contributing to this effort.
When this is ready, I would like to organize another DAWG meeting to discuss the outcome.

This is just to keep you informed about what is happening even though we do not have regular DAWG meetings currently.

Cheers
Markus


what open energy system modelers do

Robbie Morrison
 

Hello all

Interesting online meeting today.  I was not seriously suggesting that LF Energy branches out into long‑haul energy policy analysis (but thanks @eric for the suggestion nonetheless!). 

For a flavor of what open energy system modelers do, the summaries for our next online mini‑workshop in four weeks time could assist:

And to reinforce that "kinda‑open" is not sufficient for my community.  Our minimum standard for data is open data licenses.  Directly equivalent to the standard used for open source software development.  Why should we accept a lower threshold for data and content?

Open energy system models are on the cusp of becoming the default.  But open data and open standards for said data are currently major headaches.  For instance, this posting nine days ago on the static grid model for Europe that I tried to outline on the zoom call :

Quoting from that email (and this is like crawling on broken glass):

My colleague Fabian Neumann has georeferenced 90% of the substations automatically and will publish the code and results soon. If anyone wants to help him to manually georeference the other 10%, please get in touch with him! It shouldn't take too long.

The semantics that underpin the EPRI‑led reference architecture discussed today would be of very considerable interest to open energy system modelers — I am sure — but only if the data files are made public under CC‑BY‑4.0.  Software licenses don't work for data files (nor were they ever designed to do so).

More on the database directive I mentioned if interested: https://en.wikipedia.org/wiki/Database_Directive

Hard to estimate the size of our community but easily several hundred full‑time researchers.  Please help us become more productive! :)

with best wishes, Robbie

-- 
Robbie Morrison
Address: Schillerstrasse 85, 10627 Berlin, Germany
Phone: +49.30.612-87617


Event: Archimate modeling for reference architectures [Special FAWG/DAWG] - 01/20/2022 #cal-reminder

arch-data@lists.lfenergy.org Calendar <noreply@...>
 

Reminder: Archimate modeling for reference architectures [Special FAWG/DAWG]

When:
01/20/2022
7:00am to 8:30am
(UTC-08:00) America/Los Angeles

Where:
https://zoom.us/j/8655442821

Organizer: Benoit Jeanson benoit.jeanson@...

View Event

Description:
Shuli Goodman [LF Energy] is inviting you to a scheduled Zoom meeting.

Topic: Special FAWG/DAWG || Archimate modeling for reference architectures
Time: Jan 20, 2022 07:00 AM Pacific Time (US and Canada)

Join Zoom Meeting
https://zoom.us/j/8655442821

Meeting ID: 865 544 2821
One tap mobile
+13462487799,,8655442821# US (Houston)
+16465588656,,8655442821# US (New York)

Dial by your location
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington DC)
+1 312 626 6799 US (Chicago)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
+1 647 374 4685 Canada
+1 647 558 0588 Canada
+1 778 907 2071 Canada
+1 204 272 7920 Canada
+1 438 809 7799 Canada
+1 587 328 1099 Canada

855 703 8985 Canada Toll-free


Meeting ID: 865 544 2821
Find your local number: https://zoom.us/u/akSwHwgTl


Event: Archimate modeling for reference architectures [Special FAWG/DAWG] - 01/20/2022 #cal-reminder

arch-data@lists.lfenergy.org Calendar <noreply@...>
 

Reminder: Archimate modeling for reference architectures [Special FAWG/DAWG]

When:
01/20/2022
7:00am to 8:30am
(UTC-08:00) America/Los Angeles

Where:
https://zoom.us/j/8655442821

Organizer: Benoit Jeanson benoit.jeanson@...

View Event

Description:
Shuli Goodman [LF Energy] is inviting you to a scheduled Zoom meeting.

Topic: Special FAWG/DAWG || Archimate modeling for reference architectures
Time: Jan 20, 2022 07:00 AM Pacific Time (US and Canada)

Join Zoom Meeting
https://zoom.us/j/8655442821

Meeting ID: 865 544 2821
One tap mobile
+13462487799,,8655442821# US (Houston)
+16465588656,,8655442821# US (New York)

Dial by your location
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington DC)
+1 312 626 6799 US (Chicago)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
+1 647 374 4685 Canada
+1 647 558 0588 Canada
+1 778 907 2071 Canada
+1 204 272 7920 Canada
+1 438 809 7799 Canada
+1 587 328 1099 Canada

855 703 8985 Canada Toll-free


Meeting ID: 865 544 2821
Find your local number: https://zoom.us/u/akSwHwgTl


Upcoming Events #cal-summary

arch-data@lists.lfenergy.org Calendar <arch-data@...>
 

Data Architecture WG Upcoming Events

Archimate modeling for reference architectures [Special FAWG/DAWG]

When:
Thursday, January 20, 2022, 7:00am to 8:30am
(GMT-08:00) America/Los Angeles

Where:
https://zoom.us/j/8655442821

Organizer: Benoit Jeanson benoit.jeanson@...

Details:
Shuli Goodman [LF Energy] is inviting you to a scheduled Zoom meeting.

Topic: Special FAWG/DAWG || Archimate modeling for reference architectures
Time: Jan 20, 2022 07:00 AM Pacific Time (US and Canada)

Join Zoom Meeting
https://zoom.us/j/8655442821

Meeting ID: 865 544 2821
One tap mobile
+13462487799,,8655442821# US (Houston)
+16465588656,,8655442821# US (New York)

Dial by your location
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington DC)
+1 312 626 6799 US (Chicago)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
+1 647 374 4685 Canada
+1 647 558 0588 Canada
+1 778 907 2071 Canada
+1 204 272 7920 Canada
+1 438 809 7799 Canada
+1 587 328 1099 Canada

855 703 8985 Canada Toll-free


Meeting ID: 865 544 2821
Find your local number: https://zoom.us/u/akSwHwgTl

View Event


Upcoming Events #cal-summary

arch-data@lists.lfenergy.org Calendar <arch-data@...>
 

Data Architecture WG Upcoming Events

Archimate modeling for reference architectures [Special FAWG/DAWG]

When:
Thursday, January 20, 2022, 7:00am to 8:30am
(GMT-08:00) America/Los Angeles

Where:
https://zoom.us/j/8655442821

Organizer: Benoit Jeanson benoit.jeanson@...

Details:
Shuli Goodman [LF Energy] is inviting you to a scheduled Zoom meeting.

Topic: Special FAWG/DAWG || Archimate modeling for reference architectures
Time: Jan 20, 2022 07:00 AM Pacific Time (US and Canada)

Join Zoom Meeting
https://zoom.us/j/8655442821

Meeting ID: 865 544 2821
One tap mobile
+13462487799,,8655442821# US (Houston)
+16465588656,,8655442821# US (New York)

Dial by your location
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington DC)
+1 312 626 6799 US (Chicago)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
+1 647 374 4685 Canada
+1 647 558 0588 Canada
+1 778 907 2071 Canada
+1 204 272 7920 Canada
+1 438 809 7799 Canada
+1 587 328 1099 Canada

855 703 8985 Canada Toll-free


Meeting ID: 865 544 2821
Find your local number: https://zoom.us/u/akSwHwgTl

View Event


Upcoming Events #cal-summary

arch-data@lists.lfenergy.org Calendar <arch-data@...>
 

Data Architecture WG Upcoming Events

Archimate modeling for reference architectures [Special FAWG/DAWG]

When:
Thursday, January 20, 2022, 7:00am to 8:30am
(GMT-08:00) America/Los Angeles

Where:
https://zoom.us/j/8655442821

Organizer: Benoit Jeanson benoit.jeanson@...

Details:
Shuli Goodman [LF Energy] is inviting you to a scheduled Zoom meeting.

Topic: Special FAWG/DAWG || Archimate modeling for reference architectures
Time: Jan 20, 2022 07:00 AM Pacific Time (US and Canada)

Join Zoom Meeting
https://zoom.us/j/8655442821

Meeting ID: 865 544 2821
One tap mobile
+13462487799,,8655442821# US (Houston)
+16465588656,,8655442821# US (New York)

Dial by your location
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington DC)
+1 312 626 6799 US (Chicago)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
+1 647 374 4685 Canada
+1 647 558 0588 Canada
+1 778 907 2071 Canada
+1 204 272 7920 Canada
+1 438 809 7799 Canada
+1 587 328 1099 Canada

855 703 8985 Canada Toll-free


Meeting ID: 865 544 2821
Find your local number: https://zoom.us/u/akSwHwgTl

View Event


Upcoming Events #cal-summary

arch-data@lists.lfenergy.org Calendar <arch-data@...>
 

Data Architecture WG Upcoming Events

Archimate modeling for reference architectures [Special FAWG/DAWG]

When:
Thursday, January 20, 2022, 7:00am to 8:30am
(GMT-08:00) America/Los Angeles

Where:
https://zoom.us/j/8655442821

Organizer: Benoit Jeanson benoit.jeanson@...

Details:
Shuli Goodman [LF Energy] is inviting you to a scheduled Zoom meeting.

Topic: Special FAWG/DAWG || Archimate modeling for reference architectures
Time: Jan 20, 2022 07:00 AM Pacific Time (US and Canada)

Join Zoom Meeting
https://zoom.us/j/8655442821

Meeting ID: 865 544 2821
One tap mobile
+13462487799,,8655442821# US (Houston)
+16465588656,,8655442821# US (New York)

Dial by your location
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington DC)
+1 312 626 6799 US (Chicago)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
+1 647 374 4685 Canada
+1 647 558 0588 Canada
+1 778 907 2071 Canada
+1 204 272 7920 Canada
+1 438 809 7799 Canada
+1 587 328 1099 Canada

855 703 8985 Canada Toll-free


Meeting ID: 865 544 2821
Find your local number: https://zoom.us/u/akSwHwgTl

View Event


Upcoming Events #cal-summary

arch-data@lists.lfenergy.org Calendar <arch-data@...>
 

Data Architecture WG Upcoming Events

Archimate modeling for reference architectures [Special FAWG/DAWG]

When:
Thursday, January 20, 2022, 7:00am to 8:30am
(GMT-08:00) America/Los Angeles

Where:
https://zoom.us/j/8655442821

Organizer: Benoit Jeanson benoit.jeanson@...

Details:
Shuli Goodman [LF Energy] is inviting you to a scheduled Zoom meeting.

Topic: Special FAWG/DAWG || Archimate modeling for reference architectures
Time: Jan 20, 2022 07:00 AM Pacific Time (US and Canada)

Join Zoom Meeting
https://zoom.us/j/8655442821

Meeting ID: 865 544 2821
One tap mobile
+13462487799,,8655442821# US (Houston)
+16465588656,,8655442821# US (New York)

Dial by your location
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington DC)
+1 312 626 6799 US (Chicago)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
+1 647 374 4685 Canada
+1 647 558 0588 Canada
+1 778 907 2071 Canada
+1 204 272 7920 Canada
+1 438 809 7799 Canada
+1 587 328 1099 Canada

855 703 8985 Canada Toll-free


Meeting ID: 865 544 2821
Find your local number: https://zoom.us/u/akSwHwgTl

View Event


Upcoming Events #cal-summary

arch-data@lists.lfenergy.org Calendar <arch-data@...>
 

Data Architecture WG Upcoming Events

Archimate modeling for reference architectures [Special FAWG/DAWG]

When:
Thursday, January 20, 2022, 7:00am to 8:30am
(GMT-08:00) America/Los Angeles

Where:
https://zoom.us/j/8655442821

Organizer: Benoit Jeanson benoit.jeanson@...

Details:
Shuli Goodman [LF Energy] is inviting you to a scheduled Zoom meeting.

Topic: Special FAWG/DAWG || Archimate modeling for reference architectures
Time: Jan 20, 2022 07:00 AM Pacific Time (US and Canada)

Join Zoom Meeting
https://zoom.us/j/8655442821

Meeting ID: 865 544 2821
One tap mobile
+13462487799,,8655442821# US (Houston)
+16465588656,,8655442821# US (New York)

Dial by your location
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington DC)
+1 312 626 6799 US (Chicago)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
+1 647 374 4685 Canada
+1 647 558 0588 Canada
+1 778 907 2071 Canada
+1 204 272 7920 Canada
+1 438 809 7799 Canada
+1 587 328 1099 Canada

855 703 8985 Canada Toll-free


Meeting ID: 865 544 2821
Find your local number: https://zoom.us/u/akSwHwgTl

View Event


Event: Kafka survey - with all interested members - 12/09/2021 #cal-reminder

arch-data@lists.lfenergy.org Calendar <noreply@...>
 

Reminder: Kafka survey - with all interested members

When:
12/09/2021
7:00am to 8:00am
(UTC-08:00) America/Los Angeles

Where:
https://zoom.us/j/94151322554

Organizer: Eric Houmes Eric.Houmes@...

View Event

Description:

Goals:

-first of all: Share available slide-ware on purpose and application of Kafka in our landscapes

-final outcome: Define a reference architecture for LFE from this to be able to guide projects and future members and maybe the data platform developments


+++++++++++++++++++++++++++++++++++++++++

Eric Houmes is inviting you to a scheduled Zoom meeting. Topic: Data-Arch - Kafka-based Architectures Time: Dec 9, 2021 07:00 AM Pacific Time (US and Canada) Join Zoom Meeting https://zoom.us/j/94151322554 Meeting ID: 941 5132 2554 One tap mobile +16465588656,,94151322554# US (New York) +16699006833,,94151322554# US (San Jose) Dial by your location +1 646 558 8656 US (New York) +1 669 900 6833 US (San Jose) +1 253 215 8782 US (Tacoma) +1 301 715 8592 US (Washington DC) +1 312 626 6799 US (Chicago) +1 346 248 7799 US (Houston) 855 880 1246 US Toll-free 877 369 0926 US Toll-free +1 647 558 0588 Canada +1 778 907 2071 Canada +1 204 272 7920 Canada +1 438 809 7799 Canada +1 587 328 1099 Canada +1 647 374 4685 Canada 855 703 8985 Canada Toll-free Meeting ID: 941 5132 2554 Find your local number: https://zoom.us/u/acKONENIgM

 


Event: Archimate modeling for reference architectures [Special FAWG/DAWG] - Thursday, January 20, 2022 #cal-invite

arch-data@lists.lfenergy.org Calendar <noreply@...>
 

Archimate modeling for reference architectures [Special FAWG/DAWG]

When:
Thursday, January 20, 2022
7:00am to 8:30am
(UTC-08:00) America/Los Angeles

Where:
https://zoom.us/j/8655442821

Organizer: Benoit Jeanson benoit.jeanson@...

View Event

Description:
Shuli Goodman [LF Energy] is inviting you to a scheduled Zoom meeting.

Topic: Special FAWG/DAWG || Archimate modeling for reference architectures
Time: Jan 20, 2022 07:00 AM Pacific Time (US and Canada)

Join Zoom Meeting
https://zoom.us/j/8655442821

Meeting ID: 865 544 2821
One tap mobile
+13462487799,,8655442821# US (Houston)
+16465588656,,8655442821# US (New York)

Dial by your location
+1 346 248 7799 US (Houston)
+1 646 558 8656 US (New York)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
+1 301 715 8592 US (Washington DC)
+1 312 626 6799 US (Chicago)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
+1 647 374 4685 Canada
+1 647 558 0588 Canada
+1 778 907 2071 Canada
+1 204 272 7920 Canada
+1 438 809 7799 Canada
+1 587 328 1099 Canada

855 703 8985 Canada Toll-free


Meeting ID: 865 544 2821
Find your local number: https://zoom.us/u/akSwHwgTl


Open letter to IEA and member countries requesting open data

Robbie Morrison
 

Hello list

The Open Energy Modelling Initiative (or "openmod") just coordinated a letter to the International Energy Agency seeking open data and forwarded it earlier today to Dr Fatih Birol. Most of the IEA data is paywalled and subject to non‑disclosure, despite having been collected and supplied by member governments under public funding. Our letter was signed by 37 researchers. The text of that letter (but not the signatories) is on our discussion server:

The open letter process was inspired by two Oxford university researchers, Hannah Ritchie and Max Roser. More here:

with best wishes, Robbie

-- 
Robbie Morrison
Address: Schillerstrasse 85, 10627 Berlin, Germany
Phone: +49.30.612-87617


Event: Kafka survey - with all interested members - 12/09/2021 #cal-reminder

arch-data@lists.lfenergy.org Calendar <noreply@...>
 

Reminder: Kafka survey - with all interested members

When:
12/09/2021
7:00am to 8:00am
(UTC-08:00) America/Los Angeles

Where:
https://zoom.us/j/94151322554

Organizer: Eric Houmes Eric.Houmes@...

View Event

Description:

Goals:

-first of all: Share available slide-ware on purpose and application of Kafka in our landscapes

-final outcome: Define a reference architecture for LFE from this to be able to guide projects and future members and maybe the data platform developments


+++++++++++++++++++++++++++++++++++++++++

Eric Houmes is inviting you to a scheduled Zoom meeting. Topic: Data-Arch - Kafka-based Architectures Time: Dec 9, 2021 07:00 AM Pacific Time (US and Canada) Join Zoom Meeting https://zoom.us/j/94151322554 Meeting ID: 941 5132 2554 One tap mobile +16465588656,,94151322554# US (New York) +16699006833,,94151322554# US (San Jose) Dial by your location +1 646 558 8656 US (New York) +1 669 900 6833 US (San Jose) +1 253 215 8782 US (Tacoma) +1 301 715 8592 US (Washington DC) +1 312 626 6799 US (Chicago) +1 346 248 7799 US (Houston) 855 880 1246 US Toll-free 877 369 0926 US Toll-free +1 647 558 0588 Canada +1 778 907 2071 Canada +1 204 272 7920 Canada +1 438 809 7799 Canada +1 587 328 1099 Canada +1 647 374 4685 Canada 855 703 8985 Canada Toll-free Meeting ID: 941 5132 2554 Find your local number: https://zoom.us/u/acKONENIgM

 


Re: December 2 DAWG meeting | TODO fill out Doodle

Robbie Morrison
 

Hi all

Can I flag four issues that might be usefully covered regarding Egeria.

These comments are limited to non‑personal data that could be or has been legitimately published.  That then removes GDPR and trade secrets considerations, for instance.

1  Legal metadata and public information

Metadata handling could and perhaps should support:

For some background, the UK Ofgem regulator covers both the Dublin Core and open licensing in their summary of recent public consultation:

Indeed, there is a very considerable overlap in subject matter between the regulatory work by Ofgem and the objectives set by Egeria (as I understand them). I encourage people study Ofgem's views when developing energy sector metadata processing requirements — particularly if some public facing aspect is desired (not that I have seen that provision yet articulated in LFE materials). That more preliminary work from Ofgem is to be backed up with more concrete decisions in 2022. And those pronouncements will involve some mix of guidance, mandate, and quite possibly legislative alignment.

The newly proposed EU Data Act is similar in some regards and needs to be watched also.  That draft legislation covers business‑to‑government (B2G) data sharing (such flows have yet to appear on LFE materials too).

In passing, the Icebreaker One Open Energy data platform supports both trusted brokerage (under the "terms and conditions" that Mandy mentioned) and open data dissemination (as per the aforementioned work by Ofgem). The IB1 platform is subject to English law.  And legal metadata is at the very core of their design.

2  The legal instruments that apply to the underpinning standards

I will also follow this question up with an open source legal network that I participate in and report back. Open standards are not open software and different legal considerations may apply, particularly if there ceases to be a maintained reference implementation.

3  Data semantics

  • metadata needs be formulated using a common semantic base to be translatable (unless someone manages to stumble upon Douglas Adam's fabled Babel Fish)
  • to what degree are data semantics intended to be part of the Egeria standards — or are data semantics and metadata translation regarded as solely third‑party matters?

Either way, LFE will have to grasp that nettle.

4  Interactions with overlapping projects

Some potential overlaps (albeit highly incomplete):

  • DBpedia Databus (with support for legal metadata)
  • Icebreaker One Open Energy data platform (mentioned earlier)
  • EnerMaps (more shortly)
  • work within the Open Energy Modelling Initiative

These interactions are particularly important if Egeria ultimately wants to succeed as a standard and fail as a project (as Mandy indicated wistfully in her 20211202 webinar).

Stepping back, this general journey is, in my view, as much about rapid decarbonization as it is about digitalization — indeed, the two cannot be sensibly separated. My guess is also that European utilities tend to embrace net‑zero 2050 more than do United States utilities. For instance, the recent ENTSO‑E conference was dedicated to that exact theme:

I mention just one project that perhaps overlaps with Egeria in terms of large‑scale energy data and metadata handling in the LFE context in a little more detail (simply because I attended a recent seminar): the EnerMaps (was HoTMAPS) project:

Moreover, if LF Energy overlooks the decarbonization agenda (by including and implicitly promoting the OSDU subsurface data project by Shell Oil, Schlumberger, and others, for instance), then the LFE project is less likely to succeed. I say that in a constructive way, I hope. And as an observation, public interest energy planning on all levels is probably much more established in Europe than the United States (as I under public processes in that jurisdiction) and those differences need to be recognized. And more generally, in Europe and the UK, suitably‑licensed public interest information flows are attracting increasing attention from very many quarters (as covered earlier). The United States is much better placed in regard to public sector information and published data more generally, of course.

@Shuli: I worked hard to make this posting succinct, structured, and relatively neutral in terms of framing, but also supported with suitable arguments, information, and sources.

with best wishes, Robbie

Copyright (c) 2021 Robbie Morrison <robbie.morrison@...> • This posting is licensed under a Creative Commons Attribution 4.0 International (CC‑BY‑4.0) License. • Please reuse.


On 04/12/2021 00.53, Shuli Goodman wrote:
Hi everyone - that was a great meeting. Here is the recording and transcript.

First of all - Mandy thank you! What an excellent and exciting project. You are a hero (honestly), moving the world forward with Egeria. I know everyone was impressed.
@Mandy can you send a link to the deck for people to download?

I think the next steps for us as a community are to discuss how best to move froward. The general idea would be to stand up an energy specific, power systems reference implementation. Hans, I could tell you were jumping up and down. 

I don't have a lot of time before the end of the year, but to gauge interest and keep the momentum going, I am going to put out a few times in the next two weeks. 

Here is the Doodle. Please fill out ASAP!


Thanks!
Shuli


l. shuli rose goodman phd.
executive director, LF Energy
a Linux Foundation project
twitter: @LFE_Foundation
linkedin.com/in/shuligoodman
c: +1.415.722.9688
v: +1.707.874.3231
+++++++++++++++++++++++++++
+++++++++++++++++++++++++++



-- 
Robbie Morrison
Address: Schillerstrasse 85, 10627 Berlin, Germany
Phone: +49.30.612-87617


December 2 DAWG meeting | TODO fill out Doodle

Shuli Goodman
 

Hi everyone - that was a great meeting. Here is the recording and transcript.

First of all - Mandy thank you! What an excellent and exciting project. You are a hero (honestly), moving the world forward with Egeria. I know everyone was impressed.
@Mandy can you send a link to the deck for people to download?

I think the next steps for us as a community are to discuss how best to move froward. The general idea would be to stand up an energy specific, power systems reference implementation. Hans, I could tell you were jumping up and down. 

I don't have a lot of time before the end of the year, but to gauge interest and keep the momentum going, I am going to put out a few times in the next two weeks. 

Here is the Doodle. Please fill out ASAP!


Thanks!
Shuli



l. shuli rose goodman phd.
executive director, LF Energy
a Linux Foundation project
twitter: @LFE_Foundation
linkedin.com/in/shuligoodman
c: +1.415.722.9688
v: +1.707.874.3231
+++++++++++++++++++++++++++
+++++++++++++++++++++++++++




Upcoming Events #cal-summary

arch-data@lists.lfenergy.org Calendar <arch-data@...>
 

Data Architecture WG Upcoming Events

Kafka survey - with all interested members

When:
Thursday, December 9, 2021, 7:00am to 8:00am
(GMT-08:00) America/Los Angeles

Where:
https://zoom.us/j/94151322554

Organizer: Eric Houmes Eric.Houmes@...

Details:

Goals:

-first of all: Share available slide-ware on purpose and application of Kafka in our landscapes

-final outcome: Define a reference architecture for LFE from this to be able to guide projects and future members and maybe the data platform developments


+++++++++++++++++++++++++++++++++++++++++

Eric Houmes is inviting you to a scheduled Zoom meeting. Topic: Data-Arch - Kafka-based Architectures Time: Dec 9, 2021 07:00 AM Pacific Time (US and Canada) Join Zoom Meeting https://zoom.us/j/94151322554 Meeting ID: 941 5132 2554 One tap mobile +16465588656,,94151322554# US (New York) +16699006833,,94151322554# US (San Jose) Dial by your location +1 646 558 8656 US (New York) +1 669 900 6833 US (San Jose) +1 253 215 8782 US (Tacoma) +1 301 715 8592 US (Washington DC) +1 312 626 6799 US (Chicago) +1 346 248 7799 US (Houston) 855 880 1246 US Toll-free 877 369 0926 US Toll-free +1 647 558 0588 Canada +1 778 907 2071 Canada +1 204 272 7920 Canada +1 438 809 7799 Canada +1 587 328 1099 Canada +1 647 374 4685 Canada 855 703 8985 Canada Toll-free Meeting ID: 941 5132 2554 Find your local number: https://zoom.us/u/acKONENIgM

 

View Event


Now: Special Data Architecture WG meeting with Egeria maintainer Mandy Chessell - 12/02/2021 #cal-notice

arch-data@lists.lfenergy.org Calendar <noreply@...>
 

Special Data Architecture WG meeting with Egeria maintainer Mandy Chessell

When:
12/02/2021
7:00am to 8:00am
(UTC-08:00) America/Los Angeles

Where:
https://zoom.us/j/95084598861

View Event

Description:

Please welcome Amanda (Mandy) Chessell who is the maintainer for Egeria - https://egeria.odpi.org/. - Egeria makes metadata open: automatically exchanging metadata between tools and platforms, no matter the vendor.

https://github.com/odpi/egeria - Egeria provides the Apache 2.0 licensed open metadata and governance type system, frameworks, APIs, event payloads and interchange protocols to enable tools, engines and platforms to exchange metadata in order to get the best value from data, whilst ensuring it is properly governed.

Please take the time to review before the meeting.

Meeting materials to be shared via mailing list and/or posted on the wiki at https://wiki.lfenergy.org/pages/viewpage.action?pageId=1278059

Join Zoom Meeting https://zoom.us/j/95084598861

Meeting ID: 950 8459 8861 One tap mobile +13017158592,,95084598861# US (Washington DC) +13126266799,,95084598861# US (Chicago)

Dial by your location +1 301 715 8592 US (Washington DC) +1 312 626 6799 US (Chicago) +1 646 558 8656 US (New York) +1 253 215 8782 US (Tacoma) +1 346 248 7799 US (Houston) +1 669 900 6833 US (San Jose) 877 369 0926 US Toll-free 855 880 1246 US Toll-free +1 647 374 4685 Canada +1 647 558 0588 Canada +1 778 907 2071 Canada +1 204 272 7920 Canada +1 438 809 7799 Canada +1 587 328 1099 Canada 855 703 8985 Canada Toll-free Meeting ID: 950 8459 8861 Find your local number: https://zoom.us/u/adUj8Iw4DH


Event: Special Data Architecture WG meeting with Egeria maintainer Mandy Chessell - 12/02/2021 #cal-reminder

arch-data@lists.lfenergy.org Calendar <noreply@...>
 

Reminder: Special Data Architecture WG meeting with Egeria maintainer Mandy Chessell

When:
12/02/2021
7:00am to 8:00am
(UTC-08:00) America/Los Angeles

Where:
https://zoom.us/j/95084598861

View Event

Description:

Please welcome Amanda (Mandy) Chessell who is the maintainer for Egeria - https://egeria.odpi.org/. - Egeria makes metadata open: automatically exchanging metadata between tools and platforms, no matter the vendor.

https://github.com/odpi/egeria - Egeria provides the Apache 2.0 licensed open metadata and governance type system, frameworks, APIs, event payloads and interchange protocols to enable tools, engines and platforms to exchange metadata in order to get the best value from data, whilst ensuring it is properly governed.

Please take the time to review before the meeting.

Meeting materials to be shared via mailing list and/or posted on the wiki at https://wiki.lfenergy.org/pages/viewpage.action?pageId=1278059

Join Zoom Meeting https://zoom.us/j/95084598861

Meeting ID: 950 8459 8861 One tap mobile +13017158592,,95084598861# US (Washington DC) +13126266799,,95084598861# US (Chicago)

Dial by your location +1 301 715 8592 US (Washington DC) +1 312 626 6799 US (Chicago) +1 646 558 8656 US (New York) +1 253 215 8782 US (Tacoma) +1 346 248 7799 US (Houston) +1 669 900 6833 US (San Jose) 877 369 0926 US Toll-free 855 880 1246 US Toll-free +1 647 374 4685 Canada +1 647 558 0588 Canada +1 778 907 2071 Canada +1 204 272 7920 Canada +1 438 809 7799 Canada +1 587 328 1099 Canada 855 703 8985 Canada Toll-free Meeting ID: 950 8459 8861 Find your local number: https://zoom.us/u/adUj8Iw4DH

1 - 20 of 260