The Yanagisawa family originated with Yoshimitsu of Seiwa Genji (who assumed the name Saburo Shinra upon adulthood), a native of Kai (current-day Yamanashi Prefecture). The family enjoyed particularly close ties with the Takeda family of Kai, with its roots tracked to Mukawa-Yanagisawa village in the Koma district of Kai (current-day Yanagisawa in Mukawa Town, Hokuto City, Yamanashi Prefecture).
Yanagisawa Nobutoshi served under Takeda Shingen and his son Katsuyori. After the fall of the Takeda family, Nobutoshi served the great Shogun Tokugawa Ieyasu. Yanagisawa Yasutada was originally a vassal of the Tokugawa Shogun, but later served Tokugawa Tsunayoshi, head of the Tatebayashi domain and excelled as chief financial advisor. After this, Yanagisawa Yoshiyasu, eldest son of Yasutada, went on to serve as the grand chamberlain of the fifth generation Shogun, Tokugawa Tsunayoshi.
Yoshiyasu earned recognition for his loyal service, and was appointed to serve as top ranking senior councilor. He was subsequently presented with Kawagoe Castle and then Kofu Castle, emerging as a great daimyo lord overseeing castles with massive rice stipends.
In 1724, Yoshiyasu’s eldest son Yoshisato succeeded his father, and then was ordered to rule over Koriyama Castle with the high rice stipend kept in place. The Yanagisawa family continued to reign supreme in that region for more than a hundred years, until the official establishment of prefectures to replace the feudal domain system in July of 1871.