Usual spelling in Scotland is Jarvie. Worth bearing in mind when searching.
And I've seen it as Jarvis. Probably best to search for Jarv* to be sure to cover all bases.
I have some Jarveys in my tree. There are conflicting stories about the origin of the name, though they seem to be agreed that it is from the personal name Gervase.
According to G F Black's
The Surnames of Scotland the earliest documented mention of the name is in Stirling in 1527.
There are a lot of trees online saying that John Jarvey, vintner in Bathgate, was born 26 July 1719 in Guienne, Normandy. (Guienne is in Aquitaine, not in Normandy, though there could be another place of the same name in Normandy). They are all copied from a tree by Bonnie Hickox, which contains several major errors.
There is also a tree by Naomi Simpson Beck which says he was George Gervaise, born about 1740 in Guienne, Normandy. This is plainly nonsense as he married in Bathgate in 1748. In any case Beck's tree also contains some other major errors, so cannot be relied on.
There is another tree, not online, of the family of Sir James Young Simpson saying that his grandfather John Jarvey was born at the farm of Boghall in the parish of Bathgate.
A biography of Sir James Young Simpson [Duns, 1873] says that, "John Jarvey, farmer at Balbardie, near Bathgate, was descended from a Huguenot family, who had been settled for some time at Torwood, Stirlingshire, whence they removed, at the latter end of the seventeenth century, to the farm of Boghall, Bathgate, which members of the house held for nearly a hundred years".
Note, however, that the earliest mention of the name, in 1527, is pre-Reformation and therefore before there were such people as Huguenots.
Jervis(e) or Jarvis is also from the personal name Gervase. The earliest mention of this surname, according to Black, was in 1287.
All variants of the name seem to be concentrated in east central Scotland - Stirling, West Lothian, Angus, Peebles, Falkirk.