Birmingham residents said they were 'scared' and frustrated after their area was sealed off following a city bus stabbing.