I feel fairly lucky (for once) in that I live in rural California.
My town happens to be full of the stereotypical rednecks with guns.
While I doubt that any of them would be ready for a zombie apocalypse, what it means is that we have a massive gun store right outside of town. I live quite far from the town, and there would be little to no chance of my house becoming infected until long after the entire town falls. This means I could sit on my porch until I saw fire and such in the town signaling that it had almost fallen, and then drive down to the gun store and take whatever I could carry in an old extended F-150 (quite a lot).
From there, I'd try to get back to my house, or better, the radio towers on the top of the mountain I live on. From there, I'd either set up a radio signal telling people to come to the "outpost", or simply wait it out. This would depend on the how readily food is available. Lots of food = room for lots of people, and by extension, lots of gun-wielders. Little food = in-fighting over food, and bad things overall.
As soon as I had a firm footing established in the radio towers, I'd go back down to my town, and it's sister town to collect all of my friends who'd survived the initial attack.
Collecting friends could be risky, since it would be harder to kill them assuming they were infected, but friends will fight for eachother harder, and ensure fewer people are infected overall. In the long run, I think having friends would be good.
For food, I'd first scavenge what I can from town, and the mountain I live on. From there, I would hunt, seeing as I have lots of guns and I live on a rural mountain with lots of deer and turkeys. If hunting proves to be a viable source of protein, all I would need is the other vitamins and such that are required in far lesser amounts. We have a health-food store in town, and I could likely find some vitamin pills or similar. Water is a fairly small problem, as gasoline is abundant in this town, and we have our own well, which could be powered by a small generator.
As far as ammo goes, If it ever seems that we start getting down to the bare minimum of our reserves, I am a decent shot with a bow, and could try to hunt for food that way. If zombies arrive, we would probably be forced to use guns, but they'd be reserved for that only.
In case of disease, I can see two options per sickness.
If it is something curable by the options we have currently, we'll simply cure that person. If it is something incurable, we will do our best to find a better physician, before asking whether the person wants to be killed rather than die from whatever the ailment is. If dialysis works on zombie bites, we will try that first, but if the zombie infection is truly unstoppable once initiated, anyone showing signs of zombification will be shot immediately, in a remote location as to avoid contamination with current supplies and people.
As you can see, I've put an alarming amount of thought into this. I'd love to hear comments or criticism of this plan, since it's a little hobby of mine, to think of things like this.
Also, Arbiter;
If the zombie disease is bloodbourne, you could not live off of the zombies. Simply eating one would quickly infect you. Also, you probably underestimate how hard it would be to actually try to eat a fellow (ex-)human. Try it one day, see for yourself.