|
Mirz, Markus <markus.mirz@...>
Hello,
I had a look at the API that electricitymap is using to pull real-time ENTSOE data.
As you can see here:
https://transparency.entsoe.eu/content/static_content/Static%20content/web%20api/Guide.html
The data is structured according to iec62325.351:tc57wg16.
IEC 62325 is based on CIM (IEC 61970) and developed by the same technical committee.
The CIM IEC core model describes everything that you need to run a power flow.
That means that (among many other things) it lets you define nodes and branches of the network as well as their characteristics (e.g. active and reactive power in/output and line impedance).
It seems to me that bringing these things together might not be that difficult after all
😊
Cheers
Markus
|
|
|
Great research intelligence!
Thanks, Markus!
l. shuli rose goodman phd. executive director, LF Energy
a Linux Foundation project twitter: @LFE_Foundation +++++++++++++++++++++++++++ +++++++++++++++++++++++++++
Hello, I had a look at the API that electricitymap is using to pull real-time ENTSOE data. As you can see here: The data is structured according to iec62325.351:tc57wg16. IEC 62325 is based on CIM (IEC 61970) and developed by the same technical committee. The CIM IEC core model describes everything that you need to run a power flow. That means that (among many other things) it lets you define nodes and branches of the network as well as their characteristics (e.g. active and reactive power in/output and line impedance). It seems to me that bringing these things together might not be that difficult after all 😊 Cheers Markus
|
|
|
Hi Markus,
Thank you for looking into that. I'd like to propose and get the group's feedback on doing a landscape assessment as a first step in this process. Specifically, if we could create e.g. an sheets template for all working groups members to fill out which requests: - Power systems data metrics of interest (e.g. hourly plant level generation and emissions, hourly imports / exports, nodal prices)
- Best examples of where that data exists today -> how, in what format (e.g. ENTSOE, EIA)
- Challenges with the existing data today (e.g. granularity, frequency, data quality, access, non standard technology nomenclature)
- Example of use case (this is a "good to know", but I don't think we should index on any particular use case at this point given the Phase I scope)
We can then analyze and discuss responses, find areas of overlap / common issues and needs in order to help develop a more discrete outline of what this specification will look like and to ensure alignment on what we are working towards. Let me know what you think, and if others have feedback on this idea as well, please feel free to chime in.
Thanks, Hallie
On Thu, Feb 3, 2022 at 11:25 AM Shuli Goodman < sgoodman@...> wrote: Great research intelligence!
Thanks, Markus!
l. shuli rose goodman phd. executive director, LF Energy
a Linux Foundation project twitter: @LFE_Foundation +++++++++++++++++++++++++++ +++++++++++++++++++++++++++
Hello, I had a look at the API that electricitymap is using to pull real-time ENTSOE data. As you can see here: The data is structured according to iec62325.351:tc57wg16. IEC 62325 is based on CIM (IEC 61970) and developed by the same technical committee. The CIM IEC core model describes everything that you need to run a power flow. That means that (among many other things) it lets you define nodes and branches of the network as well as their characteristics (e.g. active and reactive power in/output and line impedance). It seems to me that bringing these things together might not be that difficult after all 😊 Cheers Markus
|
|
|
Hallie, This sounds like a great next step. I've found it useful to categorize these types of issues into "produced" and "consumed" buckets. For example, hourly plant level generation would fall into "produced". By contrast, "consumed" includes imports/exports and (potentially) transmission constraints. There might be other buckets, but maybe this is a good enough starting point.
Should this happen within a Github issue? On a shared Google sheet? Airtable? Happy to take the lead on setting something up if we agree on how/where to best brainstorm.
Thanks! McGee
-- McGee Young Founder and CEO 414-759-2599
|
|
|
Mirz, Markus <markus.mirz@...>
Hi Hallie,
I think it’s a good idea to do this landscape assessment first.
Shuli and I discussed your proposal today and thought about a tool to make this landscape very visual and engage members in the creation.
Having a picture would also help in explaining what we are doing to potential candidates who are interested in joining this effort.
The miro board here could be one possibility to create the landscape:
https://miro.com/app/board/uXjVOOeqLlw=/?invite_link_id=905940576550
What do you think about this way of creating the landscape?
Thanks
Markus
toggle quoted message
Show quoted text
From: Hallie Cramer <halliecramer@...>
Sent: Wednesday, February 9, 2022 11:37 PM
To: Shuli Goodman <sgoodman@...>
Cc: Mirz, Markus <markus.mirz@...>; cdsc-power-system-data-wg@...
Subject: Re: [CDSC Power System Data WG] CIM CGMES and ENTSOE real-time electricity data
Hi Markus,
Thank you for looking into that. I'd like to propose and get the group's feedback on doing a landscape assessment as a first step in this process. Specifically, if we could create e.g. an sheets template for all working groups members to
fill out which requests:
-
Power systems data metrics of interest (e.g. hourly plant level generation and emissions, hourly imports / exports, nodal prices)
-
Best examples of where that data exists today -> how, in what format (e.g. ENTSOE, EIA)
-
Challenges with the existing data today (e.g. granularity, frequency, data quality, access, non standard technology nomenclature)
-
-
Example of use case (this is a "good to know", but I don't think we should index on any particular use case at this point given the Phase I scope)
We can then analyze and discuss responses, find areas of overlap / common issues and needs in order to help develop a more discrete outline of what this specification will look like and to ensure alignment on what we are working towards.
Let me know what you think, and if others have feedback on this idea as well, please feel free to chime in.
On Thu, Feb 3, 2022 at 11:25 AM Shuli Goodman <sgoodman@...> wrote:
Great research intelligence!
Thanks, Markus!
l. shuli rose goodman phd.
executive director, LF Energy
a Linux Foundation project
+++++++++++++++++++++++++++
+++++++++++++++++++++++++++
+++++++++++++++++++++++++++
I had a look at the API that electricitymap is using to pull real-time ENTSOE data.
The data is structured according to iec62325.351:tc57wg16.
IEC 62325 is based on CIM (IEC 61970) and developed by the same technical committee.
The CIM IEC core model describes everything that you need to run a power flow.
That means that (among many other things) it lets you define nodes and branches of the network as well as their characteristics (e.g. active and reactive power in/output and line impedance).
It seems to me that bringing these things together might not be that difficult after all 😊
|
|
|
Hi Markus,
I think this is interesting and a good way to visualize! My only potential concern is if there are data sources or challenges that are specific to only one or a subset of the metrics, will there be an easy way to track that linkage here? But maybe for an initial mapping, that is less important.
Best, Hallie
Hi Hallie,
I think it’s a good idea to do this landscape assessment first.
Shuli and I discussed your proposal today and thought about a tool to make this landscape very visual and engage members in the creation.
Having a picture would also help in explaining what we are doing to potential candidates who are interested in joining this effort.
The miro board here could be one possibility to create the landscape:
https://miro.com/app/board/uXjVOOeqLlw=/?invite_link_id=905940576550
What do you think about this way of creating the landscape?
Thanks
Markus
Hi Markus,
Thank you for looking into that. I'd like to propose and get the group's feedback on doing a landscape assessment as a first step in this process. Specifically, if we could create e.g. an sheets template for all working groups members to
fill out which requests:
-
Power systems data metrics of interest (e.g. hourly plant level generation and emissions, hourly imports / exports, nodal prices)
-
Best examples of where that data exists today -> how, in what format (e.g. ENTSOE, EIA)
-
Challenges with the existing data today (e.g. granularity, frequency, data quality, access, non standard technology nomenclature)
-
-
Example of use case (this is a "good to know", but I don't think we should index on any particular use case at this point given the Phase I scope)
We can then analyze and discuss responses, find areas of overlap / common issues and needs in order to help develop a more discrete outline of what this specification will look like and to ensure alignment on what we are working towards.
Let me know what you think, and if others have feedback on this idea as well, please feel free to chime in.
On Thu, Feb 3, 2022 at 11:25 AM Shuli Goodman <sgoodman@...> wrote:
Great research intelligence!
Thanks, Markus!
l. shuli rose goodman phd.
executive director, LF Energy
a Linux Foundation project
+++++++++++++++++++++++++++
+++++++++++++++++++++++++++
+++++++++++++++++++++++++++
I had a look at the API that electricitymap is using to pull real-time ENTSOE data.
The data is structured according to iec62325.351:tc57wg16.
IEC 62325 is based on CIM (IEC 61970) and developed by the same technical committee.
The CIM IEC core model describes everything that you need to run a power flow.
That means that (among many other things) it lets you define nodes and branches of the network as well as their characteristics (e.g. active and reactive power in/output and line impedance).
It seems to me that bringing these things together might not be that difficult after all 😊
|
|
|
Mirz, Markus <markus.mirz@...>
Hi Hallie,
Yes, I think that you can track these links as well if the number of tags is not too large, but of course this visual representation does not scale well.
It might be good in the beginning to discuss and set our direction.
At some point we will need to switch to something different, e.g. table based, as you suggested.
On Wednesday, we have our next power system data WG meeting. My proposal would be to invite all members to contribute to this mind map…
After a first round of populating the map, we have an initial version of the landscape and can decide the next step.
This map could also help in identifying the columns that we require in the table sheet eventually.
Do you think this is a good way forward?
Cheers
Markus
toggle quoted message
Show quoted text
From: Hallie Cramer <halliecramer@...>
Sent: Thursday, February 10, 2022 11:24 PM
To: Mirz, Markus <markus.mirz@...>
Cc: Shuli Goodman <sgoodman@...>; cdsc-power-system-data-wg@...
Subject: Re: [CDSC Power System Data WG] CIM CGMES and ENTSOE real-time electricity data
Hi Markus,
I think this is interesting and a good way to visualize! My only potential concern is if there are data sources or challenges that are specific to only one or a subset of the metrics, will there be an easy way to track that linkage here?
But maybe for an initial mapping, that is less important.
Hi Hallie,
I think it’s a good idea to do this landscape assessment first.
Shuli and I discussed your proposal today and thought about a tool to make this landscape very visual and engage members in the creation.
Having a picture would also help in explaining what we are doing to potential candidates who are interested in joining this effort.
The miro board here could be one possibility to create the landscape:
https://miro.com/app/board/uXjVOOeqLlw=/?invite_link_id=905940576550
What do you think about this way of creating the landscape?
Thanks
Markus
Hi Markus,
Thank you for looking into that. I'd like to propose and get the group's feedback on doing a landscape assessment as a first step in this process. Specifically, if we could create
e.g. an sheets template for all working groups members to fill out which requests:
-
Power systems data metrics of interest (e.g. hourly plant level generation and emissions, hourly imports / exports, nodal prices)
-
Best examples of where that data exists today -> how, in what format (e.g. ENTSOE, EIA)
-
Challenges with the existing data today (e.g. granularity, frequency, data quality, access, non standard technology nomenclature)
-
-
Example of use case (this is a "good to know", but I don't think we should index on any particular use case at this point given the Phase I scope)
We can then analyze and discuss responses, find areas of overlap / common issues and needs in order to help develop a more discrete outline of what this specification will look
like and to ensure alignment on what we are working towards. Let me know what you think, and if others have feedback on this idea as well, please feel free to chime in.
On Thu, Feb 3, 2022 at 11:25 AM Shuli Goodman <sgoodman@...> wrote:
Great research intelligence!
Thanks, Markus!
l. shuli rose goodman phd.
executive director, LF Energy
a Linux Foundation project
+++++++++++++++++++++++++++
+++++++++++++++++++++++++++
+++++++++++++++++++++++++++
I had a look at the API that electricitymap is using to pull real-time ENTSOE data.
The data is structured according to iec62325.351:tc57wg16.
IEC 62325 is based on CIM (IEC 61970) and developed by the same technical committee.
The CIM IEC core model describes everything that you need to run a power flow.
That means that (among many other things) it lets you define nodes and branches of the network as well as their characteristics (e.g. active and reactive power
in/output and line impedance).
It seems to me that bringing these things together might not be that difficult after all 😊
|
|
|
Hi Markus,
That sounds good to me!
Thanks, Hallie
Hi Hallie,
Yes, I think that you can track these links as well if the number of tags is not too large, but of course this visual representation does not scale well.
It might be good in the beginning to discuss and set our direction.
At some point we will need to switch to something different, e.g. table based, as you suggested.
On Wednesday, we have our next power system data WG meeting. My proposal would be to invite all members to contribute to this mind map…
After a first round of populating the map, we have an initial version of the landscape and can decide the next step.
This map could also help in identifying the columns that we require in the table sheet eventually.
Do you think this is a good way forward?
Cheers
Markus
Hi Markus,
I think this is interesting and a good way to visualize! My only potential concern is if there are data sources or challenges that are specific to only one or a subset of the metrics, will there be an easy way to track that linkage here?
But maybe for an initial mapping, that is less important.
Hi Hallie,
I think it’s a good idea to do this landscape assessment first.
Shuli and I discussed your proposal today and thought about a tool to make this landscape very visual and engage members in the creation.
Having a picture would also help in explaining what we are doing to potential candidates who are interested in joining this effort.
The miro board here could be one possibility to create the landscape:
https://miro.com/app/board/uXjVOOeqLlw=/?invite_link_id=905940576550
What do you think about this way of creating the landscape?
Thanks
Markus
Hi Markus,
Thank you for looking into that. I'd like to propose and get the group's feedback on doing a landscape assessment as a first step in this process. Specifically, if we could create
e.g. an sheets template for all working groups members to fill out which requests:
-
Power systems data metrics of interest (e.g. hourly plant level generation and emissions, hourly imports / exports, nodal prices)
-
Best examples of where that data exists today -> how, in what format (e.g. ENTSOE, EIA)
-
Challenges with the existing data today (e.g. granularity, frequency, data quality, access, non standard technology nomenclature)
-
-
Example of use case (this is a "good to know", but I don't think we should index on any particular use case at this point given the Phase I scope)
We can then analyze and discuss responses, find areas of overlap / common issues and needs in order to help develop a more discrete outline of what this specification will look
like and to ensure alignment on what we are working towards. Let me know what you think, and if others have feedback on this idea as well, please feel free to chime in.
On Thu, Feb 3, 2022 at 11:25 AM Shuli Goodman <sgoodman@...> wrote:
Great research intelligence!
Thanks, Markus!
l. shuli rose goodman phd.
executive director, LF Energy
a Linux Foundation project
+++++++++++++++++++++++++++
+++++++++++++++++++++++++++
+++++++++++++++++++++++++++
I had a look at the API that electricitymap is using to pull real-time ENTSOE data.
The data is structured according to iec62325.351:tc57wg16.
IEC 62325 is based on CIM (IEC 61970) and developed by the same technical committee.
The CIM IEC core model describes everything that you need to run a power flow.
That means that (among many other things) it lets you define nodes and branches of the network as well as their characteristics (e.g. active and reactive power
in/output and line impedance).
It seems to me that bringing these things together might not be that difficult after all 😊
|
|
|
