Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluation

doi:doi:10.57702/a0jcr8w3

Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluation

New Natural Language Process (NLP) benchmarks are urgently needed to align with the rapid development of large language models (LLMs). We present Xiezhi, the most comprehensive evaluation suite designed to assess holistic domain knowledge.

BibTex:

@dataset{Zhouhong_Gu_and_Xiaoxuan_Zhu_and_Haoning_Ye_and_Lin_Zhang_and_Jianchen_Wang_and_Yixin_Zhu_and_Sihang_Jiang_and_Zhuozhi_Xiong_and_Zihan_Li_and_Weijie_Wu_and_Qianyu_He_and_Rui_Xu_and_Wenhao_Huang_and_Jingping_Liu_and_Zili_Wang_and_Shusen_Wang_and_Weiguo_Zheng_and_Hongwei_Feng_and_Yanghua_Xiao_2024,
    abstract = {New Natural Language Process (NLP) benchmarks are urgently needed to align with the rapid development of large language models (LLMs). We present Xiezhi, the most comprehensive evaluation suite designed to assess holistic domain knowledge.},
    author = {Zhouhong Gu and Xiaoxuan Zhu and Haoning Ye and Lin Zhang and Jianchen Wang and Yixin Zhu and Sihang Jiang and Zhuozhi Xiong and Zihan Li and Weijie Wu and Qianyu He and Rui Xu and Wenhao Huang and Jingping Liu and Zili Wang and Shusen Wang and Weiguo Zheng and Hongwei Feng and Yanghua Xiao},
    doi = {10.57702/a0jcr8w3},
    institution = {No Organization},
    keyword = {'domain knowledge', 'holistic evaluation', 'large language models'},
    month = {dec},
    publisher = {TIB},
    title = {Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluation},
    url = {https://service.tib.eu/ldmservice/dataset/xiezhi--an-ever-updating-benchmark-for-holistic-domain-knowledge-evaluation},
    year = {2024}
}