Hypothesis
Fine-tuning general-purpose language models on text descriptions of polymers could match fingerprint-based methods for predicting glass transition, melting and decomposition temperatures, while skipping hand-built representations.
What failed
On a curated set of 11,740 entries, both fine-tuned LLMs generally fell short of Polymer Genome, polyGNN and polyBERT in accuracy and were less computationally efficient; multi-task training did not help the LLMs, which failed to exploit correlations between properties.
Broken assumption
Natural-language transfer learning can stand in for domain-specific chemical representations in polymer property prediction.
Why
Analysis of the learned embeddings suggests general-purpose LLMs do not capture fine chemical-structure information as well as handcrafted features or domain-specific embeddings.
From the published paper: Gupta et al. Macromolecular Rapid Communications, 2025. ↗CC BY