sphinx_rtd_theme doesn't support rtl languages yet
luckily, it looks like support might be close
see this issue: readthedocs/sphinx_rtd_theme#291
and this PR: readthedocs/sphinx_rtd_theme#986
upgrade when that PR is merged.