There is a railway station in Berwick upon Tweed, from here there is a bus service to Holy Island which operates 01 April - 01 September. Otherwise you will need to take a taxi. At the end of your walk, likely to be staying in Wall or Chollerford.  Regular buses run between Wall and Hexham.  From Hexham you can catch buses to Newcastle along with a train service.