Report
View in EDS

Results of the Big ANN: NeurIPS'23 competition

Bibliographic Details
Title: Results of the Big ANN: NeurIPS'23 competition
Authors: Simhadri, Harsha Vardhan, Aumüller, Martin, Ingber, Amir, Douze, Matthijs, Williams, George, Manohar, Magdalen Dobson, Baranchuk, Dmitry, Liberty, Edo, Liu, Frank, Landrum, Ben, Karjikar, Mazin, Dhulipala, Laxman, Chen, Meng, Chen, Yue, Ma, Rui, Zhang, Kai, Cai, Yuzheng, Shi, Jiayang, Chen, Yizhuo, Zheng, Weiguo, Wan, Zihao, Yin, Jie, Huang, Ben
Publication Year: 2024
Collection: Computer Science
Subject Terms: Computer Science - Information Retrieval, Computer Science - Data Structures and Algorithms, Computer Science - Machine Learning, Computer Science - Performance, H.3.3
More Details: The 2023 Big ANN Challenge, held at NeurIPS 2023, focused on advancing the state-of-the-art in indexing data structures and search algorithms for practical variants of Approximate Nearest Neighbor (ANN) search that reflect the growing complexity and diversity of workloads. Unlike prior challenges that emphasized scaling up classical ANN search ~\cite{DBLP:conf/nips/SimhadriWADBBCH21}, this competition addressed filtered search, out-of-distribution data, sparse and streaming variants of ANNS. Participants developed and submitted innovative solutions that were evaluated on new standard datasets with constrained computational resources. The results showcased significant improvements in search accuracy and efficiency over industry-standard baselines, with notable contributions from both academic and industrial teams. This paper summarizes the competition tracks, datasets, evaluation metrics, and the innovative approaches of the top-performing submissions, providing insights into the current advancements and future directions in the field of approximate nearest neighbor search.
Comment: Code: https://github.com/harsha-simhadri/big-ann-benchmarks/releases/tag/v0.3.0
Document Type: Working Paper
Access URL: http://arxiv.org/abs/2409.17424
Accession Number: edsarx.2409.17424
Database: arXiv
FullText Text:
  Availability: 0
CustomLinks:
  – Url: http://arxiv.org/abs/2409.17424
    Name: EDS - Arxiv
    Category: fullText
    Text: View this record from Arxiv
    MouseOverText: View this record from Arxiv
  – Url: https://resolver.ebsco.com/c/xy5jbn/result?sid=EBSCO:edsarx&genre=article&issn=&ISBN=&volume=&issue=&date=20240925&spage=&pages=&title=Results of the Big ANN: NeurIPS'23 competition&atitle=Results%20of%20the%20Big%20ANN%3A%20NeurIPS%2723%20competition&aulast=Simhadri%2C%20Harsha%20Vardhan&id=DOI:
    Name: Full Text Finder (for New FTF UI) (s8985755)
    Category: fullText
    Text: Find It @ SCU Libraries
    MouseOverText: Find It @ SCU Libraries
Header DbId: edsarx
DbLabel: arXiv
An: edsarx.2409.17424
RelevancyScore: 1112
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 1112.25854492188
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Results of the Big ANN: NeurIPS'23 competition
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Simhadri%2C+Harsha+Vardhan%22">Simhadri, Harsha Vardhan</searchLink><br /><searchLink fieldCode="AR" term="%22Aumüller%2C+Martin%22">Aumüller, Martin</searchLink><br /><searchLink fieldCode="AR" term="%22Ingber%2C+Amir%22">Ingber, Amir</searchLink><br /><searchLink fieldCode="AR" term="%22Douze%2C+Matthijs%22">Douze, Matthijs</searchLink><br /><searchLink fieldCode="AR" term="%22Williams%2C+George%22">Williams, George</searchLink><br /><searchLink fieldCode="AR" term="%22Manohar%2C+Magdalen+Dobson%22">Manohar, Magdalen Dobson</searchLink><br /><searchLink fieldCode="AR" term="%22Baranchuk%2C+Dmitry%22">Baranchuk, Dmitry</searchLink><br /><searchLink fieldCode="AR" term="%22Liberty%2C+Edo%22">Liberty, Edo</searchLink><br /><searchLink fieldCode="AR" term="%22Liu%2C+Frank%22">Liu, Frank</searchLink><br /><searchLink fieldCode="AR" term="%22Landrum%2C+Ben%22">Landrum, Ben</searchLink><br /><searchLink fieldCode="AR" term="%22Karjikar%2C+Mazin%22">Karjikar, Mazin</searchLink><br /><searchLink fieldCode="AR" term="%22Dhulipala%2C+Laxman%22">Dhulipala, Laxman</searchLink><br /><searchLink fieldCode="AR" term="%22Chen%2C+Meng%22">Chen, Meng</searchLink><br /><searchLink fieldCode="AR" term="%22Chen%2C+Yue%22">Chen, Yue</searchLink><br /><searchLink fieldCode="AR" term="%22Ma%2C+Rui%22">Ma, Rui</searchLink><br /><searchLink fieldCode="AR" term="%22Zhang%2C+Kai%22">Zhang, Kai</searchLink><br /><searchLink fieldCode="AR" term="%22Cai%2C+Yuzheng%22">Cai, Yuzheng</searchLink><br /><searchLink fieldCode="AR" term="%22Shi%2C+Jiayang%22">Shi, Jiayang</searchLink><br /><searchLink fieldCode="AR" term="%22Chen%2C+Yizhuo%22">Chen, Yizhuo</searchLink><br /><searchLink fieldCode="AR" term="%22Zheng%2C+Weiguo%22">Zheng, Weiguo</searchLink><br /><searchLink fieldCode="AR" term="%22Wan%2C+Zihao%22">Wan, Zihao</searchLink><br /><searchLink fieldCode="AR" term="%22Yin%2C+Jie%22">Yin, Jie</searchLink><br /><searchLink fieldCode="AR" term="%22Huang%2C+Ben%22">Huang, Ben</searchLink>
– Name: DatePubCY
  Label: Publication Year
  Group: Date
  Data: 2024
– Name: Subset
  Label: Collection
  Group: HoldingsInfo
  Data: Computer Science
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Science+-+Information+Retrieval%22">Computer Science - Information Retrieval</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Science+-+Data+Structures+and+Algorithms%22">Computer Science - Data Structures and Algorithms</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Science+-+Machine+Learning%22">Computer Science - Machine Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Science+-+Performance%22">Computer Science - Performance</searchLink><br /><searchLink fieldCode="DE" term="%22H%2E3%2E3%22">H.3.3</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: The 2023 Big ANN Challenge, held at NeurIPS 2023, focused on advancing the state-of-the-art in indexing data structures and search algorithms for practical variants of Approximate Nearest Neighbor (ANN) search that reflect the growing complexity and diversity of workloads. Unlike prior challenges that emphasized scaling up classical ANN search ~\cite{DBLP:conf/nips/SimhadriWADBBCH21}, this competition addressed filtered search, out-of-distribution data, sparse and streaming variants of ANNS. Participants developed and submitted innovative solutions that were evaluated on new standard datasets with constrained computational resources. The results showcased significant improvements in search accuracy and efficiency over industry-standard baselines, with notable contributions from both academic and industrial teams. This paper summarizes the competition tracks, datasets, evaluation metrics, and the innovative approaches of the top-performing submissions, providing insights into the current advancements and future directions in the field of approximate nearest neighbor search.<br />Comment: Code: https://github.com/harsha-simhadri/big-ann-benchmarks/releases/tag/v0.3.0
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Working Paper
– Name: URL
  Label: Access URL
  Group: URL
  Data: <link linkTarget="URL" linkTerm="http://arxiv.org/abs/2409.17424" linkWindow="_blank">http://arxiv.org/abs/2409.17424</link>
– Name: AN
  Label: Accession Number
  Group: ID
  Data: edsarx.2409.17424
PLink https://login.libproxy.scu.edu/login?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&scope=site&db=edsarx&AN=edsarx.2409.17424
RecordInfo BibRecord:
  BibEntity:
    Subjects:
      – SubjectFull: Computer Science - Information Retrieval
        Type: general
      – SubjectFull: Computer Science - Data Structures and Algorithms
        Type: general
      – SubjectFull: Computer Science - Machine Learning
        Type: general
      – SubjectFull: Computer Science - Performance
        Type: general
      – SubjectFull: H.3.3
        Type: general
    Titles:
      – TitleFull: Results of the Big ANN: NeurIPS'23 competition
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Simhadri, Harsha Vardhan
      – PersonEntity:
          Name:
            NameFull: Aumüller, Martin
      – PersonEntity:
          Name:
            NameFull: Ingber, Amir
      – PersonEntity:
          Name:
            NameFull: Douze, Matthijs
      – PersonEntity:
          Name:
            NameFull: Williams, George
      – PersonEntity:
          Name:
            NameFull: Manohar, Magdalen Dobson
      – PersonEntity:
          Name:
            NameFull: Baranchuk, Dmitry
      – PersonEntity:
          Name:
            NameFull: Liberty, Edo
      – PersonEntity:
          Name:
            NameFull: Liu, Frank
      – PersonEntity:
          Name:
            NameFull: Landrum, Ben
      – PersonEntity:
          Name:
            NameFull: Karjikar, Mazin
      – PersonEntity:
          Name:
            NameFull: Dhulipala, Laxman
      – PersonEntity:
          Name:
            NameFull: Chen, Meng
      – PersonEntity:
          Name:
            NameFull: Chen, Yue
      – PersonEntity:
          Name:
            NameFull: Ma, Rui
      – PersonEntity:
          Name:
            NameFull: Zhang, Kai
      – PersonEntity:
          Name:
            NameFull: Cai, Yuzheng
      – PersonEntity:
          Name:
            NameFull: Shi, Jiayang
      – PersonEntity:
          Name:
            NameFull: Chen, Yizhuo
      – PersonEntity:
          Name:
            NameFull: Zheng, Weiguo
      – PersonEntity:
          Name:
            NameFull: Wan, Zihao
      – PersonEntity:
          Name:
            NameFull: Yin, Jie
      – PersonEntity:
          Name:
            NameFull: Huang, Ben
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 25
              M: 09
              Type: published
              Y: 2024
ResultId 1