Re: Model and best track system was down earlier on Wednesday
Posted by Chris in Tampa on 9/11/2019, 5:34 pm
I would assume they are all NOAA owned servers that are located in a government facility. Whether some of those are located at the NHC I don't know. I would guess that maybe they are in Maryland or maybe located in multiple places. And after looking at some of the administrative messages I posted below, I would say probably multiple. They mention Silver Spring, Maryland and Kansas City, Missouri as having server farms.

I'm still having connection issues to their site. And best track data is only available through 12Z, 8am EDT. At HurricaneCity I'm still having the earlier connection issues too. I don't want to make any changes though because they definitely have issues on their end and I assume when everything works again things will go back to normal. If not, then I'll have to see what changes to make.

But for now, best track data remains only:
https://ftp.nhc.noaa.gov/atcf/btk/?C=M;O=D

The time code in the best track files for 94L and 95L is 2019091112 even though the files themselves were updated after 18Z, 2pm EDT. The 6 hourly position info and models just weren't released for 18Z.



Below are some of the administrative messages posted today at:
https://forecast.weather.gov/product.php?site=NWS&product=ADM&issuedby=nfd

Some of the highlights:

"NCO is aware of and investigating ongoing slowness and
errors on NIDS services as reported by the regions this
morning. NCO is assessing the health of both the
Maryland and Missouri webfarms at this time."

"NWS products (including watches and warnings) that flow through
the NWS Telecommunications Gateway are down. We are investigating
and initiating failover of related services to our alternate site
now."

"NWS Telecommunications Gateway dataflow is now restored as well."

I would say the servers are not located at the NHC and that they couldn't access them earlier if I were guessing. We'll see how long this goes on because that last line seems promising.







NOUS42 KWNO 110454
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
0450Z WED SEP 11 2019


UPDATE TO LEGACY NIDS PATCHING IN KANSAS CITY, MO...

Legacy NIDS systems in the Kansas City, MO web farm have
stabilized after 09/10 patch work. Web services will be
re-balanced back to their optimal (pre-patching) state on 09/11.
In the meantime, users may experience brief periods of slowness
on weather.gov sites. NCO will continue to monitor. For any
concerns or questions, please contact the SDM at sdmnoaa.gov or
301-683-1500.


Gerhardt/SDM/NCO/NCEP






NOUS42 KWNO 110702
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
0658Z WED SEP 11 2019

NCO is currently investigating a problem with the AHPS Website
not loading correctly (https://water.weather.gov/ahps/).


Gerhardt/SDM/NCO/NCEP






NOUS42 KWNO 110821
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
0810Z WED SEP 11 2019

AHPS web services have been re-balanced between Silver Spring and
Kansas City Legacy NIDS web farms in order to stabilize the AHPS
site. NCO will continue to monitor. If users notice any
additional problems with AHPS or other weather.gov web services,
please contact Tech Control at toc.nwstgnoaa.gov or 301-683-1518.


Gerhardt/SDM/NCO/NCEP






NOUS42 KWNO 111341
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
1332Z WED SEP 11 2019


LEGACY NIDS FAILOVER TODAY...
Due to planned patching for the Silver Spring NIDS platform
tomorrow, Thursday, September 12th, NWWS-OI, NWSChat, and
Ra4-gifs will be failoed over to the Missouri NIDS farm
at 1600Z today, September 11, 2019.

There may be an outage of up to an hour during the NWSChat
and NWWS-OI failovers.


12Z MODEL PRODUCTION STATUS...
The 12Z NAM started on time with 12 Alaskan...26 Canadian...
74 CONUS...11 Mexican...11 Caribbean...and 8 Pacific stations
available for ingest.


12Z NAM RAOB RECAP...
72476/GJT - Purged winds 105-100mb...too slow...spurious dirs.
91413/YAP - Purged temps/moisture 546-432mb...2-4 degrees too
cold.
70308/SNP - Not available for the NAM.
70026/BRW - 10159.
91765/PPG - 10142...Ground equipment failure.
76458/MZT - 10142...Ground equipment failure.
76692/HYY - 10158...Flight equipment failure.
78988/CUR - 10142...Ground equipment failure.
78807/PCZ - Missing Part TTBB.


CRITICAL WEATHER DAY STATUS...
NCEP does not anticipate a CWD during the next 3 days.


Kempisty/SDM/NCO/NCEP






NOUS42 KWNO 111501
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
1459Z WED SEP 11 2019


LEGACY NIDS STATUS AND SCHEDULED FAILOVER TODAY...
NCO is aware of and investigating ongoing slowness and
errors on NIDS services as reported by the regions this
morning. NCO is assessing the health of both the
Maryland and Missouri webfarms at this time.

Due to planned patching for the Silver Spring NIDS platform
tomorrow, Thursday, September 12th, NWWS-OI, NWSChat, and
Ra4-gifs is scheduled to be failed over to the Missouri NIDS
farm at 1600Z today, September 11, 2019.

There may be an outage of up to an hour during the NWSChat
and NWWS-OI failovers.


12Z MODEL PRODUCTION STATUS...
The 12Z GFS started on time with 12 Alaskan...26 Canadian...
74 CONUS...11 Mexican...11 Caribbean...and 8 Pacific stations
available for ingest.


UPDATED 12Z GFS RAOB RECAP...
72476/GJT - Purged winds 105-100mb...too slow...spurious dirs.
91413/YAP - Purged temps/moisture 546-432mb...2-4 degrees too
cold.
70308/SNP - Not available for the NAM...10140...Report not
filed for the GFS.
70026/BRW - 10159.
91765/PPG - 10142...Ground equipment failure.
76458/MZT - 10142...Ground equipment failure.
76692/HYY - 10158...Flight equipment failure.
78988/CUR - 10142...Ground equipment failure.
78807/PCZ - Missing Part TTBB...Full report in for the GFS.


Kempisty/SDM/NCO/NCEP






NOUS42 KWNO 111604
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
1603Z WED SEP 11 2019


LEGACY NIDS STATUS AND SCHEDULED FAILOVER TODAY...
NCO continues to investigate ongoing AHPS issues that
sites have reported this morning.

The failover of NWWS-OI, NWSChat, and RA4-gifs to the
Missouri NIDS farm has been postponed until 17Z today,
September 11, 2019.

As previusly noted, there may be an outage of up to an
hour during the NWSChat and NWWS-OI failovers.


Kempisty/SDM/NCO/NCEP






NOUS42 KWNO 111707
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
1705Z WED SEP 11 2019


NWSCHAT FAILOVER...
The NWSChat failover is starting now. Users can expect
up to an hour outage of NWSChat services.


Kempisty/SDM/NCO/NCEP






NOUS42 KWNO 111838
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
1836Z WED SEP 11 2019

NCO is investigating problems with the flow of MRMS data. NWSChat
database restoration continues...we are estimating restoration in
the next 30-60 minutes.

Handel/SDM/NCO/NCEP






NOUS42 KWNO 111852
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
1850Z WED SEP 11 2019

The problems causing a pause in MRMS dataflow have been
corrected. MRMS users should see data returning momentarily.

Handel/SDM/NCO/NCEP






NOUS42 KWNO 111909
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
1907Z WED SEP 11 2019

NWS products (including watches and warnings) that flow through
the NWS Telecommunications Gateway are down. We are investigating
and initiating failover of related services to our alternate site
now.

Handel/SDM/NCO/NCEP






NOUS42 KWNO 111926
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
1924Z WED SEP 11 2019

NWSChat is restored. Users should be able to log back in.

NWS Telecommunications Gateway dataflow is now restored as well.

Handel/SDM/NCO/NCEP
65
In this thread:
Model and best track system was down earlier on Wednesday - Chris in Tampa, 9/11/2019, 9:54 am
< Return to the front page of the: message board | monthly archive this page is in
Post A Reply
This thread has been archived and can no longer receive replies.