March 6, 2020

Weekend long read suggestions 2020/10

Software Development

psql

  • On recursive queries

    I never really give a recursion though in the context of SQL…

  • PGTune

    pgtune on web. Simple site to give you psql configuration to start with for different use-cases and server configuration.

Machine Learning

  • BERT Related Papers

    List of various papers related to BERT (Bidirectional Encoder Representations from Transformers). BERT was released by Google as part of their NLP research. But researchers are stepping forward and you can find multi-modal applications as well.

  • Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformer

    New publication by Google at the NLP space. They have published a new model called Text-To-Text Transfer Transformer (T5). They have also open-sourced a new pre-training dataset, called the Colossal Clean Crawled Corpus (C4).

  • Transformers are Graph Neural Networks

    Drawing parallels between Transformers (key component of BERT) and Graph Networks.