There are many many references in this board to proofs but they all seem to fail in many way so I wonder can we look at them again and to start this discussion off I will just say what proof usually means and then outline the many faults we find in proofs and evidences.
- usually understood to mean that something is true for everyone, everywhere and for all time and implies that you cannot avoid it. For example, Archimedes principle is true because you get the same results everywhere and anyone can test it using any data they have and it will always be true.
The ideas I give here are common in all kinds of research and can unquestionable be weaknesses of huge significance. Here I use the terms typical to the scientific community but they are of course not necessarily universal.
Cherry Picking - this occurs when you are selective or very selective about the data so you only choose examples that support your particular case or stance - in simple terms you did not do any research of your own, you took a short cut instead.
Torturing the Data - 'torture the data and it will confess to anything', as they say at Guantanamo Bay. That is you don't care at all what the data actually said you will make it say just what you want it to.
Methodology - often in a proof you cannot find a full description of the methodology, the research method, the research plan used to extract information from the data. Be honest, would you trust a research study outcome if the study owners refused to tell you how they got their results?
Authority - are you taken in by people who generate a claim because they say they are experts, well qualified so it must be right? Now of course we want to check on credentials but if we simply rely on those you will be making a big mistake. Sadly, the literature in almost every discipline it littered by well-qualified charlatans. By all means check our qualifications but don't fall into the trap of thinking that is enough for a result to be correct.
Journals and Review Sites - Often you cannot find a single reputable journals mentioned and that alone would lead me to consider rejection.
Interpretation - in research it is often said that getting the data is easy, precessing its is hard and interpreting is where we give up and lie down in a dark room and hope the problem will go away. Finding meaning is always going to be hard work because the results may not be all that clear, they may be far too clear which should always make you think you have made a mistake - some thing are just too good to be true, if you look at any set of data long enough you will find patterns, it is all to easy to be biased or lazy and look for what we want to see - so finding meaning means you need to be really knowledgeable in your area and you have to be absolutely honest. Be very wary of statistics and always get an expert to help you decide what stats you want and how to make sense of them - sadly this is often not done.
Richard Feynman, undoubtedly one of the finest brains in the world started a lecture with a very salutatory story. If you cannot understand the point he is making here with respect to this thread and more generally to research and proof then you really do need to do a lot of reading and thinking.
You know, the most amazing thing happened to me tonight. I was coming here, on the way to the lecture, and I came in through the parking lot. And you won't believe what happened. I saw a car with the licence plate ARW 357. Can you imagine? Of all the millions of licence plates in the state, what was the chance that I would see that particular one tonight? Amazing....
Over or Inappropriate Generalizations - this is just another way of making sure you understand the notion of not arguing from the particular to the Universal. That is you get one result and conclude it now applies everywhere and sadly it usually occurs when you are desperate to prove your point at any cost. A good example was created in another thread by people I shall call Andy and Cap.
Andy - Certainly the magnitude of work from that time speaks volume, if historians can claim we have wiped out the quryza using Islamic primary sources, then by the same token, they can find the man or men who dictated the Quran to the prophet in such an unparalleled style!
Cap - So because there is historical evidence for one event, there must be historical evidence for all events. Is that what you're saying?