Academic Journal
Spatiotemporal inhomogeneity of accuracy degradation in AI weather forecast foundation models: A GNSS perspective
Title: | Spatiotemporal inhomogeneity of accuracy degradation in AI weather forecast foundation models: A GNSS perspective |
---|---|
Authors: | Junsheng Ding, Wu Chen, Junping Chen, Jungang Wang, Yize Zhang, Lei Bai, Yuyan Wang, Xiaolong Mi, Tong Liu, Duojie Weng |
Source: | International Journal of Applied Earth Observations and Geoinformation, Vol 139, Iss , Pp 104473- (2025) |
Publisher Information: | Elsevier, 2025. |
Publication Year: | 2025 |
Collection: | LCC:Physical geography LCC:Environmental sciences |
Subject Terms: | Foundation models, GNSS tropospheric delay, Spatiotemporal inhomogeneity, Accuracy degradation, Weather forecast, Physical geography, GB3-5030, Environmental sciences, GE1-350 |
More Details: | The artificial intelligence (AI) weather forecast foundation models can infer and generate precise global atmospheric state forecasts on the user’s device and with speed over 10,000 times faster than the operational Integrated Forecasting System (IFS), and it is making increasingly significant contributions to geodetic applications represented by the Global Navigation Satellite System (GNSS). However, existing studies on the investigation of these AI models are typically carried out by concentrating on specific one or several meteorological events in certain regions or by comparison with physical models, and the evaluation results obtained in this manner are not comprehensive and universal. Additionally, we find that the results obtained by the foundation models through the “rollout” method for forecasting are not uniform in terms of time and space. This temporal and spatial inhomogeneity of accuracy and accuracy degradation are related to AI algorithms and attributes of training data, etc., but these characteristics have not been thoroughly explored and analyzed. In this study, we obtained the global forecast results of foundation models for 2022 and subsequently derived the GNSS tropospheric delay through numerical integration. We calculated the mean deviation, mean absolute error, and root mean square error of these data. Using these metrics, we analyzed the spatiotemporal inhomogeneity in the accuracy degradation of foundation models, represented by Huawei Cloud Pangu-Weather, Google DeepMind GraphCast, and Shanghai AI Lab FengWu. We evaluated how this inhomogeneity changes with forecast time and identified the best-performing models across different regions and forecast durations. From the results, we find that taking topography into account when training the model enhances its accuracy at high altitudes, and the facilitating influence between the high related atmospheric variables such as precipitation and water vapor. The contributions of this study are twofold: it serves as a valuable reference for geodetic and remote sensing users employing foundational models, and offers insights and case supports for AI practitioners aiming to develop more accurate models for weather forecasting. |
Document Type: | article |
File Description: | electronic resource |
Language: | English |
ISSN: | 1569-8432 |
Relation: | http://www.sciencedirect.com/science/article/pii/S1569843225001207; https://doaj.org/toc/1569-8432 |
DOI: | 10.1016/j.jag.2025.104473 |
Access URL: | https://doaj.org/article/4942496a874c4596882c398f73da34f7 |
Accession Number: | edsdoj.4942496a874c4596882c398f73da34f7 |
Database: | Directory of Open Access Journals |
FullText | Links: – Type: other Url: https://resolver.ebsco.com:443/public/rma-ftfapi/ejs/direct?AccessToken=4022AC51B5EA156FEE17&Show=Object Text: Availability: 0 CustomLinks: – Url: https://www.doi.org/10.1016/j.jag.2025.104473? Name: ScienceDirect (all content)-s8985755 Category: fullText Text: View record from ScienceDirect MouseOverText: View record from ScienceDirect – Url: https://resolver.ebsco.com/c/xy5jbn/result?sid=EBSCO:edsdoj&genre=article&issn=15698432&ISBN=&volume=139&issue=104473-&date=20250501&spage=&pages=&title=International Journal of Applied Earth Observations and Geoinformation&atitle=Spatiotemporal%20inhomogeneity%20of%20accuracy%20degradation%20in%20AI%20weather%20forecast%20foundation%20models%3A%20A%20GNSS%20perspective&aulast=Junsheng%20Ding&id=DOI:10.1016/j.jag.2025.104473 Name: Full Text Finder (for New FTF UI) (s8985755) Category: fullText Text: Find It @ SCU Libraries MouseOverText: Find It @ SCU Libraries – Url: https://doaj.org/article/4942496a874c4596882c398f73da34f7 Name: EDS - DOAJ (s8985755) Category: fullText Text: View record from DOAJ MouseOverText: View record from DOAJ |
---|---|
Header | DbId: edsdoj DbLabel: Directory of Open Access Journals An: edsdoj.4942496a874c4596882c398f73da34f7 RelevancyScore: 1044 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 1044.00451660156 |
IllustrationInfo | |
Items | – Name: Title Label: Title Group: Ti Data: Spatiotemporal inhomogeneity of accuracy degradation in AI weather forecast foundation models: A GNSS perspective – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Junsheng+Ding%22">Junsheng Ding</searchLink><br /><searchLink fieldCode="AR" term="%22Wu+Chen%22">Wu Chen</searchLink><br /><searchLink fieldCode="AR" term="%22Junping+Chen%22">Junping Chen</searchLink><br /><searchLink fieldCode="AR" term="%22Jungang+Wang%22">Jungang Wang</searchLink><br /><searchLink fieldCode="AR" term="%22Yize+Zhang%22">Yize Zhang</searchLink><br /><searchLink fieldCode="AR" term="%22Lei+Bai%22">Lei Bai</searchLink><br /><searchLink fieldCode="AR" term="%22Yuyan+Wang%22">Yuyan Wang</searchLink><br /><searchLink fieldCode="AR" term="%22Xiaolong+Mi%22">Xiaolong Mi</searchLink><br /><searchLink fieldCode="AR" term="%22Tong+Liu%22">Tong Liu</searchLink><br /><searchLink fieldCode="AR" term="%22Duojie+Weng%22">Duojie Weng</searchLink> – Name: TitleSource Label: Source Group: Src Data: International Journal of Applied Earth Observations and Geoinformation, Vol 139, Iss , Pp 104473- (2025) – Name: Publisher Label: Publisher Information Group: PubInfo Data: Elsevier, 2025. – Name: DatePubCY Label: Publication Year Group: Date Data: 2025 – Name: Subset Label: Collection Group: HoldingsInfo Data: LCC:Physical geography<br />LCC:Environmental sciences – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Foundation+models%22">Foundation models</searchLink><br /><searchLink fieldCode="DE" term="%22GNSS+tropospheric+delay%22">GNSS tropospheric delay</searchLink><br /><searchLink fieldCode="DE" term="%22Spatiotemporal+inhomogeneity%22">Spatiotemporal inhomogeneity</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy+degradation%22">Accuracy degradation</searchLink><br /><searchLink fieldCode="DE" term="%22Weather+forecast%22">Weather forecast</searchLink><br /><searchLink fieldCode="DE" term="%22Physical+geography%22">Physical geography</searchLink><br /><searchLink fieldCode="DE" term="%22GB3-5030%22">GB3-5030</searchLink><br /><searchLink fieldCode="DE" term="%22Environmental+sciences%22">Environmental sciences</searchLink><br /><searchLink fieldCode="DE" term="%22GE1-350%22">GE1-350</searchLink> – Name: Abstract Label: Description Group: Ab Data: The artificial intelligence (AI) weather forecast foundation models can infer and generate precise global atmospheric state forecasts on the user’s device and with speed over 10,000 times faster than the operational Integrated Forecasting System (IFS), and it is making increasingly significant contributions to geodetic applications represented by the Global Navigation Satellite System (GNSS). However, existing studies on the investigation of these AI models are typically carried out by concentrating on specific one or several meteorological events in certain regions or by comparison with physical models, and the evaluation results obtained in this manner are not comprehensive and universal. Additionally, we find that the results obtained by the foundation models through the “rollout” method for forecasting are not uniform in terms of time and space. This temporal and spatial inhomogeneity of accuracy and accuracy degradation are related to AI algorithms and attributes of training data, etc., but these characteristics have not been thoroughly explored and analyzed. In this study, we obtained the global forecast results of foundation models for 2022 and subsequently derived the GNSS tropospheric delay through numerical integration. We calculated the mean deviation, mean absolute error, and root mean square error of these data. Using these metrics, we analyzed the spatiotemporal inhomogeneity in the accuracy degradation of foundation models, represented by Huawei Cloud Pangu-Weather, Google DeepMind GraphCast, and Shanghai AI Lab FengWu. We evaluated how this inhomogeneity changes with forecast time and identified the best-performing models across different regions and forecast durations. From the results, we find that taking topography into account when training the model enhances its accuracy at high altitudes, and the facilitating influence between the high related atmospheric variables such as precipitation and water vapor. The contributions of this study are twofold: it serves as a valuable reference for geodetic and remote sensing users employing foundational models, and offers insights and case supports for AI practitioners aiming to develop more accurate models for weather forecasting. – Name: TypeDocument Label: Document Type Group: TypDoc Data: article – Name: Format Label: File Description Group: SrcInfo Data: electronic resource – Name: Language Label: Language Group: Lang Data: English – Name: ISSN Label: ISSN Group: ISSN Data: 1569-8432 – Name: NoteTitleSource Label: Relation Group: SrcInfo Data: http://www.sciencedirect.com/science/article/pii/S1569843225001207; https://doaj.org/toc/1569-8432 – Name: DOI Label: DOI Group: ID Data: 10.1016/j.jag.2025.104473 – Name: URL Label: Access URL Group: URL Data: <link linkTarget="URL" linkTerm="https://doaj.org/article/4942496a874c4596882c398f73da34f7" linkWindow="_blank">https://doaj.org/article/4942496a874c4596882c398f73da34f7</link> – Name: AN Label: Accession Number Group: ID Data: edsdoj.4942496a874c4596882c398f73da34f7 |
PLink | https://login.libproxy.scu.edu/login?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&scope=site&db=edsdoj&AN=edsdoj.4942496a874c4596882c398f73da34f7 |
RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1016/j.jag.2025.104473 Languages: – Text: English Subjects: – SubjectFull: Foundation models Type: general – SubjectFull: GNSS tropospheric delay Type: general – SubjectFull: Spatiotemporal inhomogeneity Type: general – SubjectFull: Accuracy degradation Type: general – SubjectFull: Weather forecast Type: general – SubjectFull: Physical geography Type: general – SubjectFull: GB3-5030 Type: general – SubjectFull: Environmental sciences Type: general – SubjectFull: GE1-350 Type: general Titles: – TitleFull: Spatiotemporal inhomogeneity of accuracy degradation in AI weather forecast foundation models: A GNSS perspective Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Junsheng Ding – PersonEntity: Name: NameFull: Wu Chen – PersonEntity: Name: NameFull: Junping Chen – PersonEntity: Name: NameFull: Jungang Wang – PersonEntity: Name: NameFull: Yize Zhang – PersonEntity: Name: NameFull: Lei Bai – PersonEntity: Name: NameFull: Yuyan Wang – PersonEntity: Name: NameFull: Xiaolong Mi – PersonEntity: Name: NameFull: Tong Liu – PersonEntity: Name: NameFull: Duojie Weng IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 05 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 15698432 Numbering: – Type: volume Value: 139 – Type: issue Value: 104473- Titles: – TitleFull: International Journal of Applied Earth Observations and Geoinformation Type: main |
ResultId | 1 |