He was appointed to the position after Zachary Kirkhorn resigned on Tuesday.
He served the company for 13 years.
"This morning Tesla announced that I’ve stepped down from my role as Chief Financial Officer, succeeded by our Chief Accounting Officer, Vaibhav Taneja," Zachary Kirkhorn wrote on Linkdln.
He said, "Being a part of this company is a special experience and I’m extremely proud of the work we’ve done together since I joined over 13 years ago."
He said: "As I shift my responsibilities to support this transition, I want to thank the talented, passionate, and hard-working employees at Tesla, who have accomplished things many thought not possible. I also want to thank Elon for his leadership and optimism, which has inspired so many people."
Vaibhav Taneja graduated from Delhi University in 1999.