What event are you running after selecting the record?

Watch the Double Double Quotes video too.  This single quote is a big reason Richard advocates using the "".

I want to have the form go to that record.  I have removed all the apostrophes in my records, but that doesn't really make sense that that has to be done.

Lookup Fields Evil Access Stuff

How are are you opening the form/going to the record? Macro or VBA?
Screenshots may be helpful?

Hi Scott, I think she meant combo box on a form.  Hi Carolyn, if it involves string concatenation, you need to double up the quotation marks.  If your combo box selection is used in a form filter in the manner shown below, then the single quote in "Homeowner's" needs to be turned into double single-quotes (''):

     v = Me.MyComboBox
     Me.Filter = "[MyField] = '" & Replace(v, "'", "''") & "'"     ' The Replace() function turns any single quote (') into double single-quote ('')
     Me.FilterOn = True

Richard has video(s) on string concatenation that explain this important topic more fully.  In a nutshell, see my picture below.  Depending on the situation, both single and double quotes may need to be doubled up.