Physicalistic determinism would require that the entire physicalistic universe would be determined. Non-compatiblistic concepts of free will generally hold that our conscious self awareness and free will is the result of "something" that is not bound by physicalism (a "soul" for want of a better word). Well, since determinism only says what will happen with regard to physicalism, then an extra-physicalisitc component to consciousness could not have physicalistic effects, but it could have extra-physicalistic effects. Once someone accepts an extra-physicalistic input into human consciousness, then one would have no problem accepting extra-physicalistic outputs. As long as the effects of extraphysicalistic free will are exclusively extraphysicalistic then physicalistic determinism and free will are completely independent of one another and no argument against that kind of free will would seem to have any validity.
An example of a non-physicalistic output to a choice made by a non-physicalistic input (soul, consciousness, what have you) would be that if the universe existed as "many worlds" fulfilling all allowed possibilities, then the output of a non-physicalistic input could be the determination of which of the myriad of worlds you are conscious within.