EDIT:
Given my time constraint and capabilities, wouldn’t using secondary sources be a (comparatively) better idea?
Short Answer
In response to the more normative question of should you rely on secondary sources in philosophy, these are empirical facts:
- Often given a lack of extant work, you have no choice and must!
- The Western philosophical tradition is more than 2,000 years old and bigger than any one person.
- Professional philosophers themselves rely heavily on anthologies and textbooks which cite important selections from important works. Then, reading encyclopedia entries such as those at SEP is generally the next best step to understanding a topic and who has contributed to it.
- Ultimately, philosophy is useful to different people in different ways.
Of course, it's preferable generally not use primary sources if one is more interested in a comprehensible overview.
Long Answer
This matter is also an epistemic question, and is related to the notion of testimony.
Taking together these facts, it's hard to escape the conclusion that even heavy use of secondary sources isn't actually the NORM in philosophy broadly. As you note, there's simply too much going on to stay well rounded not to. In fact, as a non-expert in any feel, the heavy reliance on secondary and tertiary literature over primary literature is the norm.
In my recent response to a question about Epictetus here on Philosophy SE, for instance, "primary" sources on Epictetus such are actually second-hand. No extant work exists from the thinker himself. To not use secondary sources would be irresponsible. Of course, a professional philosopher in this area will rely heavily on very specific primary, historical and philosohical sources. Other journals, contemporaries, archaeology, etc.
I purchased this philosophical encyclopedia sometime ago. Were I not saddled by adult responsibility and just read it, it would still take me an entire year to read all the volumes and make some sense of them if that's the only thing I did. Alas, I can't. And this set is essentially an attempt at a conspectus of literature.
Often, the best route to becoming somewhat of an expert on an area in philosophy is to read philosophers who select, interpret, and collate ideas around a topic professionally. Robert Audi, for instance, would be in a position to comment on epistemic matters far better than even most professional philosophers, so when you want to adequately paraphrase a concept, use the dictionary he edited which contains contributions from over 400 distinguished thinkers. If you get into a clash with a friend who has read the original work and Robert Audi who under the guidance of some experts in a field, it would seem to me that the testimony of the latter is superior from a heuristic standpoint. That goes double if your friend has an inadequate understanding of the principles of logic and language whatever her pedigree. Teachers and pundits are legitimate sources of truth in and of themselves. Audi's epistemological theory has an entire chapter that reasons why and how testimony (read secondary sources) should be used.
Lastly, and no one is an expert on your goals quite like you, if you're looking for a reasonable representation of what constitutes philosophy somewhere in between novice and expert, then why would you spend time reading most primary sources. It would be a good idea to read some of the important ones to get a taste (I personally think Uses of Argument by Toulmin should absolutely read by everyone interested in philosophy because of its views on informal logic and ordinary language). Perhaps for you given a background in finance, Wealth of Nations by Smith.
Do you absolutely have to read sources? To be a good professional philosopher, absolutely. To be a good dabbler, some is good. If you're just trying to understand the vocabulary for discussion at a party? Seems overkill. So here, like in all matters communication, context matters.