Tag: golf AI

Golfer AI Sketching: Actions

Golfer AI Sketching: Actions

by Gus Martin ♥ 1 Comment

Hello folks!

So far, we’ve described the state machine used for keeping track and modifying the behavior of the AI, and the utility function that is used to select what course of action the AI should take.

And now it’s time to talk about the other piece of the AI puzzle: Actions!

Put simply, these are the functions that the AI executes to perform an action in game; things like moving, idling, shooting etc. All of those actions are self contained in their own methods, take a parameter or three, and execute until the action is successful or fails.

Of special interest to Boss Golf is the shooting action. In golf, there are countless ways that you can hit your golf ball. You can add some backspin, you can give it some fade, you can try to go straight, you can go for a higher angle, you can go full force etc. Your success with that action, however, depends on myriad factors like your skill level, your confidence, your performance, the weather…

Therefore, for Boss Golf, when it comes to the shooting action, I’ll implement another subsystem that is based on intention, that is, the AI will tell the gameplay system what sort of shooting action it plans on executing, and the gameplay system will take all of the aforementioned factors and calculate the outcome for the AI. This will give more “human” results to the actions of the AI, as they would never be able to hit the same shot exactly the same way twice. There will always be deviations.

Breaking the system down:

  • The AI would come up with a handful of potential shooting actions for a given situation; it would think of a route by hammering it over the pond, another route by cutting through the trees, and another route by just hitting the fairway.
  • It would then parse those actions through the utility system, to see what action would be the one with the best potential reward/utility for the AI
  • After it found the best course of action, it would communicate the intention to the gameplay system, telling it it wants to:
    • Hit ball with club X
    • Hit ball with strength Y
    • Aim shot at square Z
    • Add X amount of backspin
  • The gameplay system would then modify these attributes based on the environmental factors surrounding the AI
    • If the AI is lacking confidence, add some uncertainty to the aiming
    • If the AI is behind in the championship, add some extra strength due to nerves
    • If the AI doesn’t have great skill, add way more backspin than the AI intended
    • If the AI has a lucky modifier, alter the shot slightly so that it lands in a slightly better position
  • The action is executed, the AI hits the ball with the modified intention, and analyzes the result

Of course, this is a higher level breakdown of what is going on behind the scenes, to better illustrate to you the capability of the AI. There will be a myriad other factors that can potential add a modifier to the AI’s decision. Our friend Jumper made a very nice write-up on our discord channel,  giving his take as a sports psychologist on the mind of the players and the many factors that can affect their performance on the pitch.

Now we know how to manage behavior, how to make decisions, and how to act with intention. There’s one more piece of the puzzle missing: Memory! As golfers go around the course, we want them to remember the way they tackled a hole before, so that they can try and improve on it or follow their old steps. I’ll break this feature down on my next post!

That’s it for today’s update, folks!

As an addendum, I’ve been hard at work implementing the AI, and also redoing part of the terrain system as it’s grown to be too bloated and not smart enough for the AI to work with. I’ll be done with that by the next weekend, and hopefully have some AI gameplay to show as well. Such is the nature of game development: the best ideas always come after you’ve implemented a system. This new structure will make it easy for the AI to evaluate the shots, as well as to place decorations and other structures on the course.

So stay tuned for it!

Golfer AI Sketching: Utility

Golfer AI Sketching: Utility

by Gus Martin ♥ 1 Comment

Hello folks!

Today I’ll be talking about another part of the AI of Boss Golf: Utility

Simply put, Utility is a value that determines how useful an action is for the AI to take at a specific moment in time. For example:

Take an enemy AI that has a health value and an ammo value. And it has only three possible actions:

 

  • Use Healthpack
  • Reload
  • Shoot

At the start of a conflict with a player, if the AI is at full health and full ammo, then the utility value of the first two action is pretty much zero: Shooting would be a much more useful action in that specific moment.

As the AI engages in combat with player, things get more murky. If the ammo is approaching zero, then the utility of the reload action increases; the act of reloading becomes more important than shooting as you need bullets in order to shoot. At the same time, as the health of the AI decreases, the utility factor of the use healthpack action increases, as the AI needs health otherwise it will die.

The way this calculation is done depends a lot on the factors and data that the AI has access to. If it knows that the player is at low health, then reloading first instead of healing might be a better option. If it’s a particularly coward enemy, it will give priority to heal itself instead.

And this is just with three possible actions; add in more actions, such as running, finding cover, dodging etc, and you get much more variety of behavior.

The same thing will happen in Boss Golf, specifically when it comes to deciding the type of shot to take along a hole. Let’s use a sample hole to illustrate how it would work:

tricky_hole
A tricky Par 3.

In the Par 3 above, hitting the green from the start seems like a solid choice. The hole is well within the 150 yard range, which is achievable by most golfers that take to the course. But even pros make mistake; and there’s a couple of factors that can affect the success of a stroke:

  • Wind
  • Confidence
  • Performance so far

Wind can drastically affect a stroke, making your ball go lower than expected, slower than expected, veer laterally.

Confidence can affect the quality of your stroke. Lower confidence can lead to slice/hook, lack of power, reduce your accuracy, among other things.

Performance so far. If the golfer has been having a great day, he’ll be more likely to take risks; If he’s playing his ultimate best, he might be more risk-averse in order to keep his good handicap; if he’s having a bad day, he’ll take even less chances in order to try and recover.

All of those attributes (and more) would affect the calculation for utility of the shot. For Boss Golf, the golfers would always calculate a specific number of shot (based on their attributes), calculate the utility for them, and make the choice.

Below I’ve simulated some potential shots and their results, to give you an idea of what could happen:

tricky_hole_results

Some golfers would try and keep to the straight brown shot, getting very close to the hole. Others might go the blue route since they’re lacking the confidence they’d be able to hit the ball across the lake in one go. Some might overshoot it into the green following the pink line because they believe they needed more power. The guy in the green line may have messed up his first shot due to lack of confidence. And the poor fella on the white line just sent it straight into the water hazard.

After taking the shot, the result would also affect his current attributes, affecting his next shooting decisions as a result. So if the shot landed where the golfer wanted or better, his confidence will increase, so he’ll be more prone to taking a risky shot next; by the same token, if the shot ended up going badly, his confidence could decrease, leading him to be more risk averse on his next shot.

And that’s about it. Now we know how the AI will be controlled (via State Machines) and we know how he’ll decide which action to take (via Utility).

But we’re still missing one key piece of the puzzle: the Actions themselves.

Boss Golf features an action system that limits the possibility/quality of actions by the attributes/ability of the golfer. A pro-level AI golfer will have more tools (read: shots) at his disposal than a first-timer out in the tee. He’ll know when to pull, when to push, when to chip, when to approach, and be able to use these actions when out in the green, whereas a first-timer will be limited to less imaginative and simpler shots. As they grow in skill, they’ll be able to add more shots to their arsenal.

All of that will have to be factored in by the player when designing the course. If it’s catered mainly to beginners, it makes little sense to have very difficult courses; if it’s catered to professionals, it would make little sense to have too many easy holes. This balance will be vital in the development of your golf course.

I’ll make a write-up about the actions on my next post this week. Writing about the systems like this has been very helpful in aiding me with visualizing how the system works and building it!

So expect AI integration by the end of this month, bringing life to your course!

That’s all for today folks!