How to customize Babel plugins during the compilation of Vue file templates?

When using Vue 2.7+ in my project, the compilation of template section will use the project's Babel configuration. However, I don't want the project's Babel configuration to be used exclusively for the compilation of the template section. Is it possible to customize this? And how can I customize it?