A towel drying system includes a housing that has a bottom wall, a top wall, a back wall, a front wall, a first lateral wall and a second lateral wall. The front wall has a primary air inlet extending therethrough and a primary air outlet extending therethrough. A blower is mounted in the housing and pulls air into the housing through primary air inlet and directs it outwardly through the primary air outlet. A towel support member is positioned in the housing. The front wall has at least one access door to access an interior of the housing and the towel support member. One or more towels may be placed on the towel support member. A dwelling return duct is fluidly coupled to the primary air outlet.