Moving to jeremy-chen.org

I'm moving to http://jeremy-chen.org/. Mostly.

I plan to use that site as a "self-marketing website" of sorts and to manage content in a way that I would otherwise not be able to do on blogger alone.

This blog will stay, ostensibly for more provisional ideas prior to refinement. I'll be gradually moving content (I still like) over to the other website. =)

Thursday, September 13, 2012

Goh Keng Swee on the Kind of Armed Forces Needed to Defend Singapore

"You are a Prime Minister but you have no army. How are you going to defend yourself?"
— Goh Keng Swee to Lee Kuan Yew, who had wanted a small part-time, low-cost militia

Goh Keng Swee understood that such a tiny force would be useless as a defence force. Thinking in terms of multi-period dynamics, he conceptualized a system where, each year, men of a certain age group would undergo full-time training and thereafter be part of a reserve force which would have their skills periodically refreshed. Should the need arise, an additional force perhaps more than five times the size of the full-time force might be called upon in the defence of Singapore.


Attribution: The above quote was lifted from The New Paper's Founding Fathers series.

Tuesday, September 11, 2012

Goh Keng Swee on Class Conflict

Goh Keng Swee believed that class conflict was an outmoded 19th century concept. He believed that
    "When organized labour believes that it can improve its position only by downing the other side, disaster soon overtakes the economy."
- Goh Keng Swee (1968 address to NTUC trainees)

However, Goh Keng Swee also believed that employers had to treat worker's fairly given the implied concession from labour. On one occasion, he warned employers at the Singapore Manufacturer's Association that the "unthinking and unenlightened employer who pushes his labour force around" would be dealt with severely by the government.


Attribution: This content has been largely lifted from The New Paper's Founding Fathers series.

Sunday, September 9, 2012

Lim Kim San and Goh Keng Swee on the Separation from Malaysia

"In a way, it (the separation) was a bit of a relief. In fact, all around town, people were letting off firecrackers! Dr Goh said to me, 'Here I am so worried about our future. But look, the people are celebrating.'"
- Lim Kim San, recollecting events of the separation

In fact, neither Lee Kuan Yew, Toh Chin Chye nor S. Rajaratnam wanted the separation. Goh Keng Swee understood that differences between Singapore's values and those of Peninsular Malaysia were unreconcilable and prolonged union might lead to further bloodshed. Goh played a key role in convincing the Malaysians that the only was out was for Singapore to secede completely.


Attribution: This content has been largely lifted from The New Paper's Founding Fathers series.

Friday, September 7, 2012

Lim Kim San, Without Fear or Favour (Political Anecdotes)

Even before Lim Kim San became a minster, he volunteered to be the unpaid chairman of the fledgling Housing and Development Board (HDB). Under his charge, the HDB built 26,168 housing units in its first two years. In fact, the forerunning Singapore Improvement Trust (SIT), with many more architects and years of experience, built about the same number in its 32 years.

At that time, the Minister of National Development was Ong Eng Guan who Lim Kim San reported made things difficult for him. The non-cabinet member also had to deal with PAP politicians who demanded special treatment.

When Lim Kim San declined to give special treatment to the Queenstown constituents of Parliamentary Secretary for Home Affairs Lee Siew Choh, Lee reportedly asked: "What are you here for, if not to give priority to party supporters?" Lim Kim San replied, "I am here exactly to prevent misuse of position."


Attribution: This content has been largely lifted from The New Paper's Founding Fathers series.

Sunday, August 26, 2012

On "Incentive Compatibility" in High-Frequency Trading

Today, I was reading a survey paper on convex optimization in risk management (naturally, the applications were financial), when I started thinking about high-frequency trading and how to rationally design the exchange. From the game theoretic perspective, designing such an exchange becomes less than straightforward when the interaction of rational, self-interested buyers and sellers is taken into consideration. I decided to just do this "exercise" on the bus, on my way to Maju camp for RT. (Like many, I was unaware of the 3 month shift in the deadline for doing my IPPT. Still, the exercise would be good for me. My running has deteriorated to a sad state.)

High frequency trading entails computers making lightning-fast trades, and trading agents (such as brokerages) holding positions for as little as a few seconds. As of the end of last year, it accounted for about two-thirds of trades in the US and about half of those in Europe. Last year, the Singapore Exchange (SGX) launched a new trading engine called Reach, advertising it as the world's fastest. It is unfortunate that details on how trades are cleared are not readily available for scrutiny. While the potential harm of poorly designed exchange mechanisms is not huge, inefficiencies commensurate with the frequency of trading can arise.

My objective, here, is to design an exchange so buyers and sellers have incentives to truthfully declare the maximum they are willing to buy at and the minimum they are willing to sell at. This is because given a trading mechanism that is not "truthful", outcomes can be highly inefficient (and possibly ill-defined). Here, inefficiency means that trades that might benefit some buyer and some seller might not happen. With a truthful mechanism, efficient allocations can be made that "maximize social welfare". It was thus my objective to design a good trading mechanism without paying an untenable "price of truthfulness".

Now, on to the topic at hand. In a sense, a stock exchange is not very much different from a traders’ wet market. In fact, the technical difficulties of achieving efficiency in the wet market are more severe than in the high-frequency trading market place. This is a surprising plus of the latter over the former. (This will become clear later.)

In both cases, buy and sell quotes have to be matched and cleared. (And much faster in the electronic market place.) This is when game theory seems to rear its ugly ugly head. A theorem due to Roger Myerson and Mark Satterthwaite tells us that there is no "efficient" way to trade a good between two individuals unless the lowest amount the seller is willing to sell the good at exactly matches the highest amount the buyer is willing to pay for it (i.e.: there is no buyer or seller surplus and that trade leaves no one better off, a pointless trade). This means that there are incentives to posture, pretend and hide the maximum value that one is willing to pay or the minimum value that one is willing to sell at. Anyone who has been to a market in Bangkok or Bali sees this first hand. (My girlfriend loves bargaining. I however, do not have the taste for it, perhaps making me manifestly unsuitable for wheeling and dealing.)

This unfortunate fact has correspondingly unfortunate effects on clearing trades. Let us say that a trade is matched for 1 share and the buy bid is at B (say 10) and the sell bid is at S (say 5). It is clear that the buyer must pay at most B (10) and the seller must be paid at least S (5). If the exchange stipulates that the trade clears at the any number between B and S (say the mid-point), then incentives exist for buyers to shave down (and for sellers to inflate) their bids in order to get a better deal. This is unfortunate as we need true valuations to make good allocation decisions. (In this context, "allocation" refers to clearing trades and "welfare maximization" is desirable. Also, we are not concerned about buyers inflating their bids and for sellers to shave theirs down as more trades are encouraged, and possible real losses lead to a natural restriction of this.)

Let us take a step back and consider how we might obtain matching buy-sell bids to clear. For simplicity, we consider 1 share blocks. (Though it is trivial to execute with blocks of varying sizes.) From the perspective of economics, we would like to incentivize people to truthfully inform the exchange of the lowest price one is willing to sell at (for buyers) and highest price one is willing to pay (for sellers). This allows efficient allocations. This incentive can be built into the exchange by making it possible for buyers and sellers to capture more trade surplus (the difference between transacted price and one's valuation) by bidding truthfully.

Consider the following matching procedure: pick the highest buy bid and match it with the lowest sell bid and pass that match on to clearing. This means that matches, from the pool of unsatisfied bids, are made so as to maximize the total trade surplus of that match. So "potential trade surplus reaped" will be used as an incentive for all to bid truthfully. Tentatively we will leave this at that, noting that a payment rule (to determine the clearing price) is needed to make this precise. Before getting to that, we return to the apparently ugly problem mentioned above.

I made a number of mistakes on that bus. I've thought asymmetric buyer-seller rules would work (noting that agents would buy essentially as often as they sell); I thought randomization would save the day. All those would not work. It turns out that there is a direct cost to economic efficiency that has to be paid to ensure truthfulness. What would please the board of any exchange implementing this mechanism is that the exchange can pick up what is left on the table. Let me explain.

The key requirement for truthfulness is that, all other bids being fixed, a buyer and seller pair should not be able to affect their gains by changing their bids. Changing their bids should only affect whether their trade is cleared first, and it should be clear that trades cleared first generate more "potential trade surplus". Thus, given a top buy bid B1 and second highest buy bid B2, and lowest sell bid S1 and second lowest sell bid S2, the buy price and the sell price should be functions of B2 and S2, (B2+S2)/2 being the obvious choice. If these differ (albeit slightly), the exchange pockets the difference as a "facilitation" commission.

Now moving back to the matching rule, we see that the leading buyer has no incentive to bid anything other than the maximum he is willing to pay as that would not increase his expected trade surplus (and possibly decrease it). A similar case is true for leading sellers. Ostensibly, we have achieved incentive compatibility in high-frequency exchanges.

Unfortunately, it still is not clear cut as (1) "non-leading" buyers may raise their bids and "non-leading" sellers may lower their bids to get a better match, and (2) there may be a timing issue. Due to these limitations, quotes were added to the title and "incentive compatible" was used as opposed to "truthful". Yet, these issues are far from fatally damaging to the mechanism outlined above.

On (1), the problem is ameliorated by the fact that for approximately evenly spaced buy bids and similarly spaced sell bids, non-leading bidders stand to lose if they manipulate. In fact, it can be shown that if buy bids are evenly spaced and sell bids are evenly spaced with a different spacing, if a non-leading buyer raises his bid, he only stands to gain if the "sell-side spacing" is more than twice that on the "buy-side", which is highly unlikely to persist in sustained trading by the "symmetry" of buying and selling (i.e.: the use of similar models for asset valuation) and the price mechanics led by supply and demand. A similar argument holds for sellers hoping to gain by pretending to be willing to sell for less. On (2), An agent might wonder what if a lower sell bid comes in over the next second and by posting a buy bid now, it is missed? However, in so far as things are uncertain, and one expects to lose money by holding back, this problem is not so severe. (Woo! Hand-waving. Doesn't this take you back to your school days.)

This has been a fun exercise in mechanism design. (Writing this up took longer than thinking about it.) It is quite amusing that the incentive problems in a simple setting like a traders’ wet market are more intractable than in a high-frequency exchange. Hopefully, it has demonstrated the value of the marriage of economics and computer science in our world.



Postscript 1: I feel that mechanism design has an important role to play in the evolution of the public and private spheres in Singapore. As I am embarking on a PhD in Decision Sciences at NUS Business School, I hope that I’ll be able to make some contributions in this arena. It would be appropriate to thank David Parkes for introducing me to this wonderful field. The commute up north to take his class (and missing another class I wanted to take that was back-to-back with it) was well worth it.

Postscript 2: The aforementioned matching can be done efficiently using priority queues. Certain specialized implementations are blazingly fast.

Postscript 3: An electronic marketplace may become even more interesting if a combinatorial element is introduced. That is, if bundles of different stocks in some proportions have a synergistic value. This adds horrid computational issues, and may be of dubious value. One question might be: given that in general, trades like this cannot be cleared fast, is there a non-trivial restricted class of trades that can?



Afternote 1: If the exchange would like to obtain additional revenue from each transaction or a government would like to tax transactions, it should be done as a fixed proportion of the buyer-seller trade surplus. This will preserve incentive compatibility.

Afternote 2: One of thoughts that went through my mind on that bus ride was how to sensibly do short selling in high-frequency trades. Now that this post has evolved into what it has become, this is a little off-topic. While I do not see the grave dangers of naked short selling (selling shares one does not own without first having actual shares borrowed), I feel it distorts supply/demand signals in markets and can have ill-defined effects. I was thinking of an auction for loaning shares for shorting, where the price would be the interest rate or a rental rate. A simple sequential VCG auction might be used for this.

Afternote 3: Note that this does not maximize trading volumes. To maximize trading volumes, the lowest sell bid might be matched with the lowest feasible buy bid, but this destroys incentive compatibility. This loss of potential volume, might be an additional price of incentive compatibility. It is unclear which is more costly: the price of untruthfully higher sell bids and untruthfully lower buy bids, or the price of incentive compatibility. Yet, these are hypotheticals. What is certain is, the mechanism outlined above has nice revenue properties.

Afternote 4: In view of Postscript 1, it would be interesting to compare (in simulation) this mechanism and, supposing this is not how it is done now, existing trading mechanisms. The main thing to look out for would be the total (exchange-measured) trade surplus. To do this, asset prices might generated using a (possibly very) noisy factor model, and agent valuations might be generated using (possibly bad) estimates of the aforementioned factor model. Trading strategies may then be simulated given these synthetic pieces of information.

Afternote 5: In a purely symmetric buy-sell environment, this reduces to the median price mechanism, which is nice. It is also trivially efficient since whoever values the goods the most gets them first (and whoever values them the least get rid of them soonest).

Afternote 6: Obtaining full incentive compatibility may be a matter of selecting different prices for buyer and seller using distributions on the "enclosed" bidders. This becomes a matter of using the empirical distribution to compute adaptive probabilities of setting the buy price at B2 and the sell price at S2. In these cases, the "exchange" pockets the difference to enforce incentive compatibility.

Friday, August 3, 2012

Badminton and Incentive Compatibility

I was doing my In-Camp Training this week when I read about the fiasco in Olympic badminton. I wanted to write a post about how the rules are such that they encourage bad behavior, but on coming back I found that Robert Kleinberg had already written something about the matter, titled Olympic Badminton is Not Incentive Compatible. Rather than re-work the same argument (and do so with a considerably poorer literature review), I'd like to point to his article.

At the end of his post, he wonders why shenanigans like that do not happen more in sports. I'd conjecture that advertising revenue has something to do with it. "Side payments" such as ad revenue provide subsidiary incentives to exhibit some "honor on the field". Which is probably why top teams are incentivised to be at the top of their game almost all the time. Picture perfect sporting moments bring in ad money. So it is all about payments. In sports like badminton, these payments are not substantial enough to detract from strategic skiving.

Disrepute aside, this is a wonderful example of how poor non-incentive compatible institutions generate bad outcomes for society.

Sunday, July 15, 2012

Handling the Defence of Singapore in the 21st Century

(Note: Post backdated to date of original writing.)

Two articles were published on TOC in June, Conscription: Necessary Or Outdated? (Bryan Cheang, 20 June 2012) and Rethinking Singapore’s Defence Needs (Rajiv Chaudhry, 25 June 2012), which I found to be rather off the mark. Thankfully, soon after, another article which had, I feel, a more realistic perspective on things, Conscription: The Missing Perspective (Benjamin Cheah, 3 July 2012), was posted. I would like to comment on what has been said and add, what I hope is, a little more to the discussion.

A "New Normal"??
It is naive to think that "in this age of moderation" a "new normal" has emerged characterized by all manner of warm and fuzzy sounding buzz words. Rajiv Chaudhry and, to a lesser extent, Bryan Cheang seem to think that everyone else is good and just today. But look at the way children act when unsupervised, how often do you see bigger kids taking things away from the smaller ones. Similarly, big dogs steal food from smaller dogs. In fact, for most living X's, big X's steal food from small X's unless the small X's are able to secure protection for themselves. Similarly, defence solutions have to give tangible security guarantees.

It is notable that the United States has been rather consistent in offering assistance to victims of aggression only when its interests are at stake. Certainly, Singapore has substantial strategic value as a friend to the United States, however this value to the USA is positional and is the same even is Singapore becomes an island of bombed out ruins. In the grand scheme of things, our economy is of little value to the USA, and we should remember that. More generally, military alliances and pacts to offer assistance can be breached if they are not in the counter-party's interests to honour the terms. We have to be aware that military intervention involves real costs that have to be justified from the point of view of others.

Lee Kuan Yew has one thing right: the truth about inter-country relations is that we can be friends only if we respect each others' strength. If friendships between sentimental human beings can be ephemeral, how much more fleeting can "friendships" between unfeeling nations be? Presently, deterrence is the only real way to be sure that military capabilities that can otherwise be used as a means to expropriate our property and sovereignty are not.

The Need to Intelligently Provision for Defence
I am no big fan of the SAF and its (often sycophantic) "high potentials", but let us not kid ourselves. The SAF must be sufficiently provisioned to, at least, give the semblance of being a credible force with considerable sting. The sting must be sufficiently strong to skew the cost-benefit analysis of whether or not to infringe on our sovereignty towards a "no". However, this sting comes at a cost, and we have to obtain and sustain military capabilities cost effectively. Thus, it is important that senior officers in the SAF do not adopt a "don't ask me about money, I only train" attitude or a "I only need to manage my multi-year acquisition over my tenure of two years and look good before I post out" attitude. This is not a casual swipe at career soldiers, these attitudes are not uncommon and are highly costly to Singapore. Management of those managing the acquisition and operation of military systems needs to account for the prevailing incentives and structure remuneration and advancement in a manner that promotes military strength and cost effectiveness.

On the matter of manpower, I would argue that cutting the NS and reservist liabilities based on "what others are doing", as Rajiv Chaudhry suggests, is unthinking and silly. There are ways to do so intelligently but incrementally. Let me provide a simple example:
    Consider having only 7 compulsory ICTs, the last of which is an ATEC assessment. If the reservist battalion passes, they are done with their reservist liability and will transition into the MINDEF Reserve. Otherwise they will come back for the 8th, 9th and perhaps 10th re-test sessions. This gives the incentive to build competence and also cuts the effective liability.
Granted, this is an incremental solution, but it is far better than blind copying and is likely to improve readiness as well. Similar principles can probably be applied to cutting the duration spent in full-time NS. A driven force is an effective force. It does not matter if "ORD" is what drives our NSFs to perform.

In the longer term, force structuring is the way forward to reducing ("right-sizing") the defence foot print. The ORBAT (Order of Battle) must be fluid, allowing reductions in some areas and increases in others. Capabilities will have to match the threat landscape, and capabilities that are less relevant have to be phased. Opposition to any reduction in command positions would reflect ego problems and rather than any substantive defence issue.

The Ability to Use Capabilities
The ability to effectively use equipment is crucial. The best soccer boots on an amateur team will not help them beat a barefoot Germany (because to use Brazil would simply be unfair). The man is more important than the machine.

During periods of tension, the best that can be done is to call men back for re-orientation with their equipment. How can it be expected that we will be able to use our equipment well. If technology is a force-multiplier, the lack of expertise in the use of that equipment is a force-divider. The natural question that arises is whether that number resolves to something greater or lesser than unity. Having this as the best option available to us seems to reflect a lack of foresight on the part of senior MINDEF/SAF officials/officers.

As equipment requires increasing amounts of practice and knowledge of its workings to use properly, the dictum that we do not want to have too many Singaporeans of working age tied up in the regular force has to be called into question. Economic output may suffer somewhat, but more soldiers will have the time required to build up their ability in the use of our high-tech equipment. This old assumption will have to be re-examined.

Conclusion
As Benjamin Cheah notes, the geography of the region puts us at a distinct strategic and tactical disadvantage. We have to be smart about how we handle defence. We must provision intelligently and ensure that our men have the ability to leverage our expensively obtained capabilities.

If we were to return to the issue of NS which started all this, in my mind, it would be appropriate to have a larger regular force for skill-development along with variable length NSF and reservist periods (based on demonstrated effectiveness). It might well turn out, that increased economic participation and longer economic life of Singapore males due to effective reductions in their NS liabilities more than pays for the increase in the size of the regular force.