opencompass/eval_myopenai_cmmlu.py

13 lines
482 B
Python
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

from mmengine.config import read_base
# ⚠️ import 语句必须放在 read_base() 里,才能正确解析为列表/字典
with read_base():
from opencompass.configs.models.openai.myopenai import models as openai_models
from opencompass.configs.datasets.cmmlu.cmmlu_gen import cmmlu_datasets
# 展平为普通列表,供 OpenCompass 调用
models = [*openai_models]
datasets = [*cmmlu_datasets]
# 如需自定义 runner / partitioner可在此继续添加配置