TensorFlow Hub Models - Amazon SageMaker

TensorFlow Hub Models

The following pretrained models are available to use for transfer learning with the Text Classification - TensorFlow algorithm.

The following models vary significantly in size, number of model parameters, training time, and inference latency for any given dataset. The best model for your use case depends on the complexity of your fine-tuning dataset and any requirements that you have on training time, inference latency, or model accuracy.

Model Name model_id Source

BERT Base Uncased

tensorflow-tc-bert-en-uncased-L-12-H-768-A-12-2

TensorFlow Hub link

BERT Base Cased

tensorflow-tc-bert-en-cased-L-12-H-768-A-12-2

TensorFlow Hub link

BERT Base Multilingual Cased

tensorflow-tc-bert-multi-cased-L-12-H-768-A-12-2

TensorFlow Hub link

Small BERT L-2_H-128_A-2

tensorflow-tc-small-bert-bert-en-uncased-L-2-H-128-A-2

TensorFlow Hub link

Small BERT L-2_H-256_A-4

tensorflow-tc-small-bert-bert-en-uncased-L-2-H-256-A-4

TensorFlow Hub link

Small BERT L-2_H-512_A-8

tensorflow-tc-small-bert-bert-en-uncased-L-2-H-512-A-8

TensorFlow Hub link

Small BERT L-2_H-768_A-12

tensorflow-tc-small-bert-bert-en-uncased-L-2-H-768-A-12

TensorFlow Hub link

Small BERT L-4_H-128_A-2

tensorflow-tc-small-bert-bert-en-uncased-L-4-H-128-A-2

TensorFlow Hub link

Small BERT L-4_H-256_A-4

tensorflow-tc-small-bert-bert-en-uncased-L-4-H-256-A-4

TensorFlow Hub link

Small BERT L-4_H-512_A-8

tensorflow-tc-small-bert-bert-en-uncased-L-4-H-512-A-8

TensorFlow Hub link

Small BERT L-4_H-768_A-12

tensorflow-tc-small-bert-bert-en-uncased-L-4-H-768-A-12

TensorFlow Hub link

Small BERT L-6_H-128_A-2

tensorflow-tc-small-bert-bert-en-uncased-L-6-H-128-A-2

TensorFlow Hub link

Small BERT L-6_H-256_A-4

tensorflow-tc-small-bert-bert-en-uncased-L-6-H-256-A-4

TensorFlow Hub link

Small BERT L-6_H-512_A-8

tensorflow-tc-small-bert-bert-en-uncased-L-6-H-512-A-8

TensorFlow Hub link

Small BERT L-6_H-768_A-12

tensorflow-tc-small-bert-bert-en-uncased-L-6-H-768-A-12

TensorFlow Hub link

Small BERT L-8_H-128_A-2

tensorflow-tc-small-bert-bert-en-uncased-L-8-H-128-A-2

TensorFlow Hub link

Small BERT L-8_H-256_A-4

tensorflow-tc-small-bert-bert-en-uncased-L-8-H-256-A-4

TensorFlow Hub link

Small BERT L-8_H-512_A-8

tensorflow-tc-small-bert-bert-en-uncased-L-8-H-512-A-8

TensorFlow Hub link

Small BERT L-8_H-768_A-12

tensorflow-tc-small-bert-bert-en-uncased-L-8-H-768-A-12

TensorFlow Hub link

Small BERT L-10_H-128_A-2

tensorflow-tc-small-bert-bert-en-uncased-L-10-H-128-A-2

TensorFlow Hub link

Small BERT L-10_H-256_A-4

tensorflow-tc-small-bert-bert-en-uncased-L-10-H-256-A-4

TensorFlow Hub link

Small BERT L-10_H-512_A-8

tensorflow-tc-small-bert-bert-en-uncased-L-10-H-512-A-8

TensorFlow Hub link

Small BERT L-10_H-768_A-12

tensorflow-tc-small-bert-bert-en-uncased-L-10-H-768-A-12

TensorFlow Hub link

Small BERT L-12_H-128_A-2

tensorflow-tc-small-bert-bert-en-uncased-L-12-H-128-A-2

TensorFlow Hub link

Small BERT L-12_H-256_A-4

tensorflow-tc-small-bert-bert-en-uncased-L-12-H-256-A-4

TensorFlow Hub link

Small BERT L-12_H-512_A-8

tensorflow-tc-small-bert-bert-en-uncased-L-12-H-512-A-8

TensorFlow Hub link

Small BERT L-12_H-768_A-12

tensorflow-tc-small-bert-bert-en-uncased-L-12-H-768-A-12

TensorFlow Hub link

BERT Large Uncased

tensorflow-tc-bert-en-uncased-L-24-H-1024-A-16-2

TensorFlow Hub link

BERT Large Cased

tensorflow-tc-bert-en-cased-L-24-H-1024-A-16-2

TensorFlow Hub link

BERT Large Uncased Whole Word Masking

tensorflow-tc-bert-en-wwm-uncased-L-24-H-1024-A-16-2

TensorFlow Hub link

BERT Large Cased Whole Word Masking

tensorflow-tc-bert-en-wwm-cased-L-24-H-1024-A-16-2

TensorFlow Hub link

ALBERT Base

tensorflow-tc-albert-en-base

TensorFlow Hub link

ELECTRA Small++

tensorflow-tc-electra-small-1

TensorFlow Hub link

ELECTRA Base

tensorflow-tc-electra-base-1

TensorFlow Hub link

BERT Base Wikipedia and BooksCorpus

tensorflow-tc-experts-bert-wiki-books-1

TensorFlow Hub link

BERT Base MEDLINE/PubMed

tensorflow-tc-experts-bert-pubmed-1

TensorFlow Hub link

Talking Heads Base

tensorflow-tc-talking-heads-base

TensorFlow Hub link

Talking Heads Large

tensorflow-tc-talking-heads-large

TensorFlow Hub link