The theory does not assume that debt is risk free. Debt is not risk free and there will be a beta for debt (albeit the beta would be expected to be low).
However in the Paper FM exam, when using the asset beta formula we always assume that debt is risk free and therefore the debt beta is zero.