Important Changes for Sftp Extracts
Total Page:16
File Type:pdf, Size:1020Kb
IMPORTANT CHANGES FOR SFTP EXTRACTS This document is prepared to provide information regarding the foreseen changes for SFTP extracts. These changes aim to improve the following points: • Naming convention of area names within the files, • Naming convention of folder and file names, • Reducing the size of csv files, • Avoiding repeating information within files. Details of each planned change are provided in the following sections: 1. Naming Convention of Areas On the existing SFTP files, for some of the area types (for ex: BZN, CTA) TSO names are used for area names. On the other hand, for some other types (for ex: SCA) country codes are used instead of TSO names. In order to have the same naming convention through all areas, TSO names will be replaced by country codes. When there is more than one TSO for a country, TSO names will be added in addition to country code. Each area name will have a 3-letter code at the end to specify the area type. (Ex: AT MBA) All existing area names and foreseen changes are listed in the Appendix B. 2. Naming Convention of Folder & File Names 2.1. Folder Names Data Item Number will be added to folder names. Existing format will become “DataItemName_DataItemNumber” Ex: ActualTotalLoad -> ActualTotalLoad_6.1.A A complete list of changes is available in the Appendix A. 2.2. File Names In addition to data item number, year & month format will be changed slightly. New format will be “YYYY_MM_DataItemName_DataItemNumber” Ex: 2020_9_ActualTotalLoad -> 2020_09_ActualTotalLoad_6.1.A With this change in file names, it will be possible to order files chronologically within the folder in the SFTP directory. 1 3. Encoding of The CSV Files Current encoding of UTF-16LE will be changed to UTF-8 encoding. With this change, file sizes will be reduced by ~50%. 4. Eliminating Redundant Columns In the SFTP extracts, there are some columns with repeating information that can be derivable from other information available. These columns will be eliminated to avoid repetition. Columns names to be eliminated from the existing CSV extracts are the followings: • Year • Month • Day Note: (In/Out)MapCode and (In/Out)AreaTypeCode columns will be eliminated in the long term. 5. Eliminating Files with Repeating Information For data items 17.1.B & 17.1.C, files that are available per contract type will be eliminated as the same information is available under “AmountOfBalancingReserves" and “PricesOfProcuredBalancingReserves” respectively. Ex: Data available under “AmountOfBalancingReserves” files covers all the information from below extracts: • AmountOfBalancingReservesDaily • AmountOfBalancingReservesHourly • AmountOfBalancingReservesLongTerm • AmountOfBalancingReservesMonthly • AmountOfBalancingReservesWeekly • AmountOfBalancingReservesYearly Therefore, files for per contract-type will be eliminated for the above mentioned 2 data items. 2 APPENDICIES Appendix A: Folder Naming Convention IsChanged(Except Existing Name New Name Article No) AcceptedAggregatedOffers AcceptedAggregatedOffers_17.1.D 0 ActivatedBalancingEnergy ActivatedBalancingEnergy_17.1.E 0 ActualGenerationOutputPerUnit ActualGenerationOutputPerGenerationUnit_16.1.A 1 ActualTotalLoad ActualTotalLoad_6.1.A 0 AggregatedBalancingEnergyBids AggregatedBalancingEnergyBids_12.3.E 0 AggregatedGenerationPerType AggregatedGenerationPerType_16.1.B_C 0 AggregateFillingRateWaterReservoirs AggregatedFillingRateOfWaterReservoirsAndHydroStoragePlants_16.1.D 1 AmountOfBalancingReserves AmountOfBalancingReservesUnderContract_17.1.B 1 AmountOfBalancingReservesDaily N/A N/A AmountOfBalancingReservesHourly N/A N/A AmountOfBalancingReservesLongTerm N/A N/A AmountOfBalancingReservesMonthly N/A N/A AmountOfBalancingReservesWeekly N/A N/A AmountOfBalancingReservesYearly N/A N/A CbBalancingEnergyActivated CrossBorderBalancingEnergyActivated_17.1.J 1 CbBalancingPrices CrossBorderBalancingPrices_17.1.J 1 CbBalancingVolumesOfExchanged CrossBorderBalancingVolumesOfExchangedBidsAndOffers_17.1.J 1 CongestionIncomeDaily ImplicitAllocationsCongestionIncomeDaily_12.1.E 1 CongestionIncomeIntraday ImplicitAllocationsCongestionIncomeIntraday_12.1.E 1 CostsOfCongestionManagement CostsOfCongestionManagement_13.1.C 0 Countertrading Countertrading_13.1.B 0 CrossBorderCapacityForDcLinksIntraday CrossBorderCapacityForDcLinksIntraday_11.3 0 CrossBorderPhysicalFlow PhysicalFlows_12.1.G 1 CurrentBalancingState CurrentBalancingState_12.3.A 0 CurrentGenerationForecastWindSolar CurrentGenerationForecastForWindAndSolar_14.1.D 1 DayAheadAggregatedGeneration DayAheadAggregatedGeneration_14.1.C 0 DayAheadCommercialSchedules DayAheadCommercialSchedules_12.1.F 0 DayAheadFlowBasedAllocations DayAheadFlowBasedAllocations_11.1 0 DayAheadGenerationForecastWindSolar DayAheadGenerationForecastForWindAndSolar_14.1.D 1 DayAheadPrices DayAheadPrices_12.1.D 0 DayAheadTotalLoadForecast DayAheadTotalLoadForecast_6.1.B 0 ExpansionAndDismantlingProjects ExpansionAndDismantlingProjects_9.1 0 ExplicitAuctionRevenueDaily ExplicitAllocationsAuctionRevenueDaily_12.3.A 1 ExplicitAuctionRevenueIntraday ExplicitAllocationsAuctionRevenueIntraday_12.3.A 1 ExplicitAuctionRevenueMonthly ExplicitAllocationsAuctionRevenueMonthly_12.3.A 1 ExplicitAuctionRevenueOther ExplicitAllocationsAuctionRevenueOther_12.3.A 1 ExplicitAuctionRevenueWeekly ExplicitAllocationsAuctionRevenueWeekly_12.3.A 1 ExplicitAuctionRevenueYearly ExplicitAllocationsAuctionRevenueYearly_12.3.A 1 FcrTotalCapacity FcrTotalCapacity_187.2 0 FinancialExpensesAndIncomeForBalancing FinancialExpensesAndIncomeForBalancing_17.1.I 0 FlowBasedCongestionIncomeDaily FlowBasedAllocationsCongestionIncomeDaily_12.1.E 1 3 IsChanged(Except Existing Name New Name Article No) ForecastedDayAheadTransferCapacities ForecastedDayAheadTransferCapacities_11.1 0 ForecastedMonthAheadTransferCapacities ForecastedMonthAheadTransferCapacities_11.1 0 ForecastedWeekAheadTransferCapacities ForecastedWeekAheadTransferCapacities_11.1 0 ForecastedYearAheadTransferCapacities ForecastedYearAheadTransferCapacities_11.1 0 FrrActualCapacity FrrActualCapacity_188.4 0 ImbalancePrices ImbalancePrices_17.1.G 0 InstalledGenerationCapacityAggregated InstalledGenerationCapacityAggregated_14.1.A 0 IntradayGenerationForecastWindSolar IntradayGenerationForecastForWindAndSolar_14.1.D 1 MonthAheadTotalLoadForecast MonthAheadTotalLoadForecast_6.1.D 0 NetPositionsDaily ImplicitAllocationsNetPositionsDaily_12.1.E 1 NetPositionsIntraday ImplicitAllocationsNetPositionsIntraday_12.1.E 1 OfferedDayAheadTransferCapacity OfferedDayAheadTransferCapacity_11.1 0 OfferedDayAheadTransferCapacityImplicit OfferedDayAheadTransferCapacityImplicit_11.1 0 OfferedIntradayTransferCapacity OfferedIntradayTransferCapacity_11.1 0 OfferedIntradayTransferCapacityImplicit OfferedIntradayTransferCapacityImplicit_11.1 0 OfferedMonthAheadTransferCapacity OfferedMonthAheadTransferCapacity_11.1 0 OfferedOtherTransferCapacity OfferedOtherTransferCapacity_11.1 0 OfferedWeekAheadTransferCapacity OfferedWeekAheadTransferCapacity_11.1 0 OfferedYearAheadTransferCapacity OfferedYearAheadTransferCapacity_11.1 0 OutagesGU UnavailabilityOfGenerationUnits_15.1.A_B 1 OutagesGUReasons UnavailabilityOfGenerationUnitsReasons_15.1.A_B 1 OutagesOG ChangesInActualAvailabilityOfOffshoreGridInfrastructure_10.1.C 1 OutagesOGReasons ChangesInActualAvailabilityOfOffshoreGridInfrastructureReasons_10.1.C 1 OutagesPU UnavailabilityOfProductionUnits_15.1.C_D 1 OutagesPUReasons UnavailabilityOfProductionUnitsReasons_15.1.C_D 1 OutagesTG UnavailabilityInTransmissionGrid_10.1.A_B 1 OutagesTGReasons UnavailabilityInTransmissionGridReasons_10.1.A_B 1 PlannedConsumptionUnitOutage PlannedUnavailabilityOfConsumptionUnits_7.1.A 1 PricesOfActivatedBalancingEnergy PricesOfActivatedBalancingEnergy_17.1.F 0 PricesOfProcuredBalancingReserves PricesOfProcuredBalancingReserves_17.1.C 0 PricesOfProcuredBalancingReservesDaily N/A N/A PricesOfProcuredBalancingReservesHourly N/A N/A PricesOfProcuredBalancingReservesLongTerm N/A N/A PricesOfProcuredBalancingReservesMonthly N/A N/A PricesOfProcuredBalancingReservesWeekly N/A N/A PricesOfProcuredBalancingReservesYearly N/A N/A Redispatching Redispatching_13.1.A 0 RedispatchingCrossBorder RedispatchingCrossBorder_13.1.A 0 RedispatchingInternal RedispatchingInternal_13.1.A 0 RrActualCapacity RrActualCapacity_189.3 0 ScheduledCommercialExchanges TotalCommercialSchedules_12.1.F 1 SharesOfFcrCapacity SharesOfFcrCapacity_187.2 0 TotalCapacityAllocatedDaily TotalCapacityAlreadyAllocatedDaily_12.1.C 1 TotalCapacityAllocatedIntraday TotalCapacityAlreadyAllocatedIntraday_12.1.C 1 TotalCapacityAllocatedMonthly TotalCapacityAlreadyAllocatedMonthly_12.1.C 1 4 IsChanged(Except Existing Name New Name Article No) TotalCapacityAllocatedOther TotalCapacityAlreadyAllocatedOther_12.1.C 1 TotalCapacityAllocatedWeekly TotalCapacityAlreadyAllocatedWeekly_12.1.C 1 TotalCapacityAllocatedYearly TotalCapacityAlreadyAllocatedYearly_12.1.C 1 TotalCapacityNominated TotalCapacityNominated_12.1.B 0 TotalImbalanceVolumes TotalImbalanceVolumes_17.1.H 0 TransferCapacitiesAllocatedDaily TransferCapacitiesAllocatedWithThirdCountriesDaily_12.1.H 1 TransferCapacitiesAllocatedDailyImplicit TransferCapacitiesAllocatedWithThirdCountriesDailyImplicit_12.1.H 1 TransferCapacitiesAllocatedIntraday TransferCapacitiesAllocatedWithThirdCountriesIntraday_12.1.H 1 TransferCapacitiesAllocatedMonthly TransferCapacitiesAllocatedWithThirdCountriesMonthly_12.1.H 1 TransferCapacitiesAllocatedYearly TransferCapacitiesAllocatedWithThirdCountriesYearly_12.1.H 1 UnplannedConsumptionUnitOutage ChangesInActualAvailabilityOfConsumptionUnits_7.1.B