Probabilistic Segmentation for Robust Field of View Estimation

Bibliographic Details
Title: Probabilistic Segmentation for Robust Field of View Estimation
Authors: Hallyburton, R. Spencer, Hunt, David, He, Yiwei, He, Judy, Pajic, Miroslav
Publication Year: 2025
Collection: Computer Science
Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning
More Details: Attacks on sensing and perception threaten the safe deployment of autonomous vehicles (AVs). Security-aware sensor fusion helps mitigate threats but requires accurate field of view (FOV) estimation which has not been evaluated autonomy. To address this gap, we adapt classical computer graphics algorithms to develop the first autonomy-relevant FOV estimators and create the first datasets with ground truth FOV labels. Unfortunately, we find that these approaches are themselves highly vulnerable to attacks on sensing. To improve robustness of FOV estimation against attacks, we propose a learning-based segmentation model that captures FOV features, integrates Monte Carlo dropout (MCD) for uncertainty quantification, and performs anomaly detection on confidence maps. We illustrate through comprehensive evaluations attack resistance and strong generalization across environments. Architecture trade studies demonstrate the model is feasible for real-time deployment in multiple applications.
Document Type: Working Paper
Access URL: http://arxiv.org/abs/2503.07375
Accession Number: edsarx.2503.07375
Database: arXiv
FullText Text:
  Availability: 0
CustomLinks:
  – Url: http://arxiv.org/abs/2503.07375
    Name: EDS - Arxiv
    Category: fullText
    Text: View this record from Arxiv
    MouseOverText: View this record from Arxiv
  – Url: https://resolver.ebsco.com/c/xy5jbn/result?sid=EBSCO:edsarx&genre=article&issn=&ISBN=&volume=&issue=&date=20250310&spage=&pages=&title=Probabilistic Segmentation for Robust Field of View Estimation&atitle=Probabilistic%20Segmentation%20for%20Robust%20Field%20of%20View%20Estimation&aulast=Hallyburton%2C%20R.%20Spencer&id=DOI:
    Name: Full Text Finder (for New FTF UI) (s8985755)
    Category: fullText
    Text: Find It @ SCU Libraries
    MouseOverText: Find It @ SCU Libraries
Header DbId: edsarx
DbLabel: arXiv
An: edsarx.2503.07375
RelevancyScore: 1147
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 1146.57763671875
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Probabilistic Segmentation for Robust Field of View Estimation
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Hallyburton%2C+R%2E+Spencer%22">Hallyburton, R. Spencer</searchLink><br /><searchLink fieldCode="AR" term="%22Hunt%2C+David%22">Hunt, David</searchLink><br /><searchLink fieldCode="AR" term="%22He%2C+Yiwei%22">He, Yiwei</searchLink><br /><searchLink fieldCode="AR" term="%22He%2C+Judy%22">He, Judy</searchLink><br /><searchLink fieldCode="AR" term="%22Pajic%2C+Miroslav%22">Pajic, Miroslav</searchLink>
– Name: DatePubCY
  Label: Publication Year
  Group: Date
  Data: 2025
– Name: Subset
  Label: Collection
  Group: HoldingsInfo
  Data: Computer Science
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Science+-+Computer+Vision+and+Pattern+Recognition%22">Computer Science - Computer Vision and Pattern Recognition</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Science+-+Machine+Learning%22">Computer Science - Machine Learning</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: Attacks on sensing and perception threaten the safe deployment of autonomous vehicles (AVs). Security-aware sensor fusion helps mitigate threats but requires accurate field of view (FOV) estimation which has not been evaluated autonomy. To address this gap, we adapt classical computer graphics algorithms to develop the first autonomy-relevant FOV estimators and create the first datasets with ground truth FOV labels. Unfortunately, we find that these approaches are themselves highly vulnerable to attacks on sensing. To improve robustness of FOV estimation against attacks, we propose a learning-based segmentation model that captures FOV features, integrates Monte Carlo dropout (MCD) for uncertainty quantification, and performs anomaly detection on confidence maps. We illustrate through comprehensive evaluations attack resistance and strong generalization across environments. Architecture trade studies demonstrate the model is feasible for real-time deployment in multiple applications.
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Working Paper
– Name: URL
  Label: Access URL
  Group: URL
  Data: <link linkTarget="URL" linkTerm="http://arxiv.org/abs/2503.07375" linkWindow="_blank">http://arxiv.org/abs/2503.07375</link>
– Name: AN
  Label: Accession Number
  Group: ID
  Data: edsarx.2503.07375
PLink https://login.libproxy.scu.edu/login?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&scope=site&db=edsarx&AN=edsarx.2503.07375
RecordInfo BibRecord:
  BibEntity:
    Subjects:
      – SubjectFull: Computer Science - Computer Vision and Pattern Recognition
        Type: general
      – SubjectFull: Computer Science - Machine Learning
        Type: general
    Titles:
      – TitleFull: Probabilistic Segmentation for Robust Field of View Estimation
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Hallyburton, R. Spencer
      – PersonEntity:
          Name:
            NameFull: Hunt, David
      – PersonEntity:
          Name:
            NameFull: He, Yiwei
      – PersonEntity:
          Name:
            NameFull: He, Judy
      – PersonEntity:
          Name:
            NameFull: Pajic, Miroslav
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 10
              M: 03
              Type: published
              Y: 2025
ResultId 1