Fix missing logger
#15
by abrooks9944 - opened
Currently this model is failing to load in vLLM since num_hidden_layers is undefined with the change to move the superclass config init to the bottom (related to https://github.com/vllm-project/vllm/pull/38369)
This will ensure num_hidden_layers is defined so that moe_layer_end_index can be set correctly, and also imports the logger used for the model, since it looks like it's undefined.
https://huggingface.co/baidu/ERNIE-4.5-VL-28B-A3B-PT/discussions/14 already fixes the num_hidden_layers issue, using inspect is unnecessary.
The logger fix is useful though, you're right that if anyone ever set use_recompute_moe then the config would fail to init.
abrooks9944 changed pull request title from Fix num_hidden_layers / missing logger to Fix missing logger
Cool, thanks for the quick look. Reverted the num_hidden_layers to just keep the logger fix