Architecture for tagging characters in strings with TensorFlow

Question

I would like to create a Neural Network for tagging characters in sentences. Here is an example

A sample of my dataset : s="Yesterday I went to the swimmin