I have blanks in my continuous data as the title says. I'm trying to do a pretty complex regression. I don't want to really mention exactly what type as I'd rather leave that detail out for the sake of trying to get a more general strategy or approach (unless it is absolutely necessary).
The variables that have blanks that are irritating me the most are "confidence percentages" given to me by another database that returns information on a specific IP address when you give it one.
These confidence intervals are obviously very important in the type of regressional analysis I'm doing. I know a blank just doesn't mean "nothing," a blank data point is also a sign that points to some form of variance. It would be easy to recode if it was in a categorical variable column of observations I had but it's not....it's in the list of continuous ones.
I tried doing further background research on these "blanks" by contacting the company the database is governed by and actually got ahold of their engineers (actually did this to two different companies that provide these types of databases)....their responses to my question?
"Well, we just don't have the data."
Me: "Oh, well is there any sort of context you could provide for me surrounding these 'blank cells' of data?"
"Nope, there's nothing...we just don't have the data."
Me: "Yes, as you said before, but there must be some reason you don't have the data - for instance, what caused you to decide to return blank data for that IP address? I mean, blank data cells don't mean -nothing- they are also a sign that points to some degree of variance - actually, they account for a huge degree of variance in your data and I can't recode them as 0s because that skews your continuous 'confidence percentage metric' by a GREAT deal. (They already know what I'm attempting to do regression wise btw - and one that wouldn't be competing with their services but leverage them and spend alot of money with them.) "
"Well, It's just because we don't have any data for it."
Me: "I know but I just need some clues as to why there is no data...to help me formulate some sort of strategy."
"We don't have any clues, we just have nothing because there isn't any data for that."
Me: "Ok, thanks for the customer service."
I was even on the phone with the second company on a conference call with about 5 other people who work there and it was as if what I was trying to explain bewildered them.
Most likely I suppose sharing the information I was trying to get at could of been proprietary...but who knows.
Anyways I'm left with these blanks - they tend to cause huge variances in the outcome when they appear - but they are listed as continuous variables so I can't make them a category...and can't make them a "0" as that would just be incorrect.
I'm thinking of adding some sort of regressional tree matrix as a first step (or somewhere step) within my regression to try to account for these, but I'm not exactly sure this is the right strategy.
What would you all suggest I do?