I'm afraid your version does not fit into the Victorian style - it appears a cross between Scottish Baronial, a little Brownstone (with a strange roof design), and some sort of 1960s "Mod Podge" thrown in.
Except for Queen Anne (brick) and Romanesque (stone), both of which do not resemble your model, all other Victorian subsets (Italianate, Gothic Revival, Folk, etc.) are
always constructed of wood, as this is one of the signature elements that make up the style, as were the carpenter elements added to the eaves and elesewhere.
Note that even if you changed the textures to resemble wood siding, there are other details needed to bring it into the Victorian style, not the least of which would be altering the porch (with dormer) and changing the windows. Below are several examples of Victorian style:
Eastlake:
American Folk:
Mansard:
Queen Anne:
FWIW.