I thought I'd take up the challenge on how to live plastic free with kids. Here are my thoughts.
Feeding: Well breastfeeding is obviously the go, no packaging required! However, you may want to use breastpads at some point, so go for cotton, wool or hemp! As for expressing milk in case you want to go out without baby - hand expressing is an art worth learning, you can express into glass/metal containers for storage. Not sure how well milk freezes in these however. Serving milk to baby is probably best done by cup if it's not going to be done too often, as I think most babies bottles have at least some plastic, if not in the bottle itself, at least in the teat or the screw cap.
Once baby gets older, I highly recommend baby led weaning, which is basically introducing family foods after 6 months much the same you do for adults. No need for special plastic plates, cutlery, etc, my children always wanted to use what we were using anyway. Drinking water might be a bit harder to achieve, but there's no rush on that if baby is demand breastfed beyond a year (2 years is the WHO recommendation). my youngest can feed from a small glass cup, however when left to her own devices prefers to splash the contents around!
Although plastic bibs are handy, cloth ones are good too. High chairs also come in all wood varieties (they look very funky!), however I think that belts are usually nylon-based, and buckles would be plastic...
Getting around: prams are out, I can't think of any pram I've seen that doesn't have plastic. The best solution is baby carrying, which can be done plastic-free: all cloth wraps like the hug-a-bub (there are plenty of copies, and you can also make your own), are great up to at least 18 months of age, and ring slings can also come plastic free. I love the Ergo personally, but it has plastic buckles holding the organic cotton body...
Also, I think you would be hard-pressed finding a car-seat without plastic, but these can be hired (for re-use), so hopefully that fits with the plastic-free ethos.
Poop-catching: nappying could be a challenge. I recommend looking into Elimination Communication for the most part, which avoids nappies altogether. However there may be times when nappies are required for outings, and there should be some plastic free alternatives available.
Cloth nappies can be found in cotton, hemp and bamboo (as well as many man-made materials!). Fasteners are usually plastic snaps or bamboo, but I have heard of nappies that have cloth ties, which would get around the fixing problem. Even snappies used on terry towelling squares have plastic ends. Old-fashioned safety pins could be a solution, but beware of poking baby! Nappy covers made from wool are also very handy, but need to be lanolised - which I buy in a plastic tube! Not sure if you can buy lanolin in another type of container... I also now of a modern cloth nappy that has a wool outer, so there are some quite convenient options. I also understand that nappy liners (which are very handy for avoiding nappy rash) can be made from silk - what a lovely material to be on a baby's bottom! Cloth wipes are also very handy.
A plastic bucket is invaluable for storing nappies until wash-day, though I guess you could find a metal bucket or similar to keep the nappies in and the smells out. The other thing is a water-proof bag for carrying soiled nappies in when you're out and about (the ones I use all use PUL).
It might be worth emailing one of the various on-line nappy suppliers that has a wide range of nappies and accessories to see their suggestions.
I also used a plastic change mat which is very handy, but you could probably use a soft towel on a wooden dresser top to the same effect. If it gets wee or poop on it, you have to wipe it down, no matter what material the surface is!
Sleeping: If you're demand breastfeeding, I recommend co-sleeping as a thoroughly viable option. I predominantly co-sleep with my youngest (the eldest mostly sleeps in her bed now, at age 4, but still comes into our bed occasionally!), it saves on sleep for both of us, and means one less piece of furniture in our flat (that is, no cot required). Most cots and basinettes would come with mattresses with foam or some kind of plastic product in them. Wheat filled, cloth covered mattresses can be used with some basinettes, so its worth looking into.
All the accessories: People tell you that you will need so many things for having a baby, but it's seriously overstated. I would limit making any big purchases before the baby gets here, and then only buying what you REALLY need, when you need it.
Toys: so many kids toys come in plastic form, but there are also some beautiful wooden and cotton toys to choose from. I have found my children enjoy playing with cardboard boxes or the contents of the pantry far more than with toys people give them!
Bathing: The best option is to bring baby into the bath (or shower), to save water, and for some relaxing together time. There's no real need for a plastic bath - though we did use a lovely bucket bath when my eldest was a baby, which used far less water than the bath.
I think that's all I can think of! Hope it's helpful