Gives a permit acquire took back, or keeps it back when the limit was lowered below the running queries.