What program was used to create the transformer?

The transformer architecture was introduced in the paper "Attention is All You Need" by Vaswani et al. in 2017. It was developed using TensorFlow, a popular open-source machine learning framework, though the concepts can be implemented in various programming environments. The architecture relies heavily on self-attention mechanisms and feedforward neural networks, which can be programmed in most deep learning libraries.