Why is it so hard to get a job teaching ESL in Japan?

I have been teaching for five years in South Korea. I thought it would be easier to get a job in Japan based on my experience. So why is it so hard to get a position? Since it will be my first year in Japan I am not too concerned about where or what kind of school it is.