Jackson was initially inspired towards a musical career by his father, who operated a sound system. He attended secondary school with Winston McAnuff, U Brown and Earl Sixteen, and they would perform concerts. After starting out by toasting on the Smith The Weapon sound system, Jackson progressed to the El Paso sound system, where he performed under the name Little Joe (inspired by the character from Bonanza), inspired greatly by U-Roy. He first recorded for Coxsone Dodd's Studio One in 1974, releasing "Gun Court". Initially unsuccessful as a recording artist, he studied electronics before returning to recording in the mid-1970s with greater success, having a hit with "Honda 750", which was followed by singles such as "Psalm 54", "Natty Don't Make War" and the Bionic Man-tribute "Steve Austin". "Stop Your Coming and Come" provided the first deejay hit for Sly & Robbie's Taxi label. In the latter half of the 1970s he released three albums and also returned to sound system work with U-Roy's King Sturgav setup. His big break in international terms came in 1980, when the Ray Symbolic Hi Fi sound system, with which he was then the resident deejay, toured the United Kingdom, raising his profile and helping his Weakheart Fadeaway become a major seller for Greensleeves Records. A string of further albums followed in the early 1980s, which saw Joe move away from the "cultural" chants of his early work towards the "slackness" that had become popular. Ray Symbolic's death interrupted Joe's career, but he returned as a producer, with dubs of his productions released on the King Tubby albums Original King Key Dub and Dangerous Dub. He later moved to New York City, setting up a record label, also named Ranking Joe, which provided an outlet for his productions. He proved to be a major influence on one of the most successful deejays of the early 1980s, Eek-A-Mouse.