Issues

• Move argument parsing in trainer.py from the main method.

  enhancementminor
  hplt-project/OpusTrainer#60 · Filter by author varisd opened on Sep 17, 2024

• Add a cleaning rule for URL names, such as Amazon.com -> Amazon.it

  hplt-project/OpusTrainer#58 · Filter by author gregtatum opened on Jul 19, 2024
  1

• Alignments are not updated for the PrefixModifier

  hplt-project/OpusTrainer#57 · Filter by author gregtatum opened on Mar 1, 2024
  4

• NoiseModifier should use a tokenizer to generate correct alignments

  hplt-project/OpusTrainer#55 · Filter by author gregtatum opened on Mar 1, 2024

• Synthesized alignments should be validated before producing a new sentence pair

  hplt-project/OpusTrainer#54 · Filter by author gregtatum opened on Mar 1, 2024
  1

• Merge sentences produces incorrect alignments when used with SentencePiece

  hplt-project/OpusTrainer#53 · Filter by author gregtatum opened on Mar 1, 2024
  1

• Recommended values for modifiers

  hplt-project/OpusTrainer#48 · Filter by author evgenyrp opened on Feb 6, 2024
  1

• Add a new stage starting in the training log

  enhancement
  hplt-project/OpusTrainer#47 · Filter by author onadegibert opened on Jan 26, 2024
  1

  

• Add URL Noise

  enhancement
  hplt-project/OpusTrainer#43 · Filter by author XapaJIaMnu opened on Nov 20, 2023
  1

• Could random unicode noise potentially generate invalid UTF-8

  bug
  hplt-project/OpusTrainer#42 · Filter by author XapaJIaMnu opened on Nov 20, 2023

• Add license

  hplt-project/OpusTrainer#37 · Filter by author kpu opened on Sep 27, 2023

• Replace logging with tracing

  enhancement
  hplt-project/OpusTrainer#36 · Filter by author jelmervdl opened on Sep 19, 2023

• Repeating training data beyond epoch limit if batch_size > len(dataset)

  enhancementminor
  hplt-project/OpusTrainer#30 · Filter by author jelmervdl opened on Aug 14, 2023
  1

• Use SentencePair struct instead of str internally

  enhancement
  hplt-project/OpusTrainer#29 · Filter by author jelmervdl opened on Jul 27, 2023
  4

• Save intermediate models after each stage

  enhancement
  hplt-project/OpusTrainer#16 · Filter by author onadegibert opened on Apr 25, 2023
  1

• Reading small datasets forces reshuffle and extra epochs despite number of epochs set

  enhancementminor
  hplt-project/OpusTrainer#10 · Filter by author XapaJIaMnu opened on Mar 22, 2023

• monitoring training progress

  enhancement
  hplt-project/OpusTrainer#6 · Filter by author jelmervdl opened on Mar 2, 2023
  1

• monitoring training costs

  enhancement
  hplt-project/OpusTrainer#3 · Filter by author jorgtied opened on Jan 10, 2023
  2

• Write state file during training

  hplt-project/OpusTrainer#1 · Filter by author jelmervdl opened on Jan 10, 2023 · .
  3