Hi robbiej,
Is this the father of the other Edward who went to New Jersey? You put
1851 on the title of your topic, but
1821 in the post... I assume it's 1821, since he married in 1845! Have you found him in any of the censuses? It appears to be him in 1851 as a bottle maker in Leith with wife Elizabeth and daughter Elizabeth. They are hiding in 1861, but found again in 1871 in South Leith, Edward with his son Edward, age 20 and his daughter Margaret, age 17. He is still a bottle maker, however. Are you sure about his occupation? The daughters Elizabeth and Margaret appear in the IGI (Elizabeth is an extract and Margaret a submission) for exactly the parents you named.
1871
7 Livingston Place, Leith South, Midlothian
Edward Robertson, 50, Head, born Leith, Midlothian, Bottle Maker
Edward Robertson, 20, Son, born Leith, Midlothian, Draper
Margt Robertson, 17, Daughter, born Leith, Midlothian
The good news is that Edward Sr. has survived past 1855, so there must be a record of his death on Scotland's People
All the best,
Sarah