You can get to Eastern Ukraine by train. Whether you want to do that is a different question.
You can't go any further east in in Europe by rail as the lines to Belarus and Russia are closed, but you can reach Sirkeci in Istanbul or Narva in Estonia for a safer bet.