Attrell "Prince Be" Cordes told in an interview about the song's conception, "I have to like a song before I can deal with it, the music comes first. I've always liked that Spandau Ballet song, it's so dreamy and trance-like, so when I came to deal with it, I knew I'd be daydreaming along to that one. 'Set Adrift' was so obvious to do: have the Spandau Ballet loop in there and a few other things, and dress it up a bit. That was all that was necessary." ...
Alan Jones of Music Week named it Single of the Week, commenting, "A brilliant soundscape starts with some nice vocal work, followed by the drum track from Dennis Edwards' "Don't Look Any Further" before Spandau Ballet's "True" leads into a mellow rap. A serene summer smash."[10] A reviewer from Newcastle Evening Chronicle described it as a "dreamy rap song".[11] Johnny Dee from Smash Hits named it Single of the Fortnight, calling it the "dreamiest, most laid-back record ever invented." He added, "Quite what lyrics like "rubber bands expand in a frustrating sigh" mean is a total mystery, but if ever a record could be described as — aherm — like being massaged by a bag of marshmallows, then this is it. Melt city!"[12] While reviewing Of the Heart, of the Soul and of the Cross: The Utopian Experience, the magazine's Gary Kipper stated that the song "is, of course, one of the most summery records ever made".[13] Jonathan Bernstein from Spin wrote, "The hit track, the play track, the ultimate "Huh?" inducer, "Set Adrift on Memory Bliss" is a classic of languid lassitude. Deadpan as De La doing "West End Girls", "Memory" opens with a laconically drawled "The camera pans the cocktail glass behind a blind of plastic plants" and just gets better from there."