Technical ReportPDF Available

AUTONOMOUS FOREST MACHINES - PAST, PRESENT AND FUTURE

Authors:

Abstract and Figures

The feasibility of using autonomous forest vehicles (which can be regarded as logical developments in the ongoing automation of forest machines), the systems that could be applied in them, their potential advantages and their limitations (in the foreseeable future) are considered here. The aims were to analyse: (1) the factors influencing the degree of automation in logging; (2) the technical principles that can be applied to autonomous forest machines, and (3) the feasibility of developing an autonomous path-tracking forest vehicle. A class of such vehicles that are believed to have considerable commercial potential is autonomous wood shuttles (forwarders). The degree of automation is influenced by increased productivity, the machine operator as a bottle-neck, cost reduction, and environmental aspects. Technical principles that can be applied to autonomous forest vehicles are satellite navigation, laser odometry, wheel odometry, laser scanner and radar. The presented system has demonstrated both possibilities and difficulties associated with autonomous forest machines. It is in a field study shown that it is quite possible for them to learn and track a path previously demonstrated by an operator with an accuracy of 0.1m on flat ground. A new path-tracking algorithm has been developed to reduce deviations by utilizing the driver’s steering commands.
Content may be subject to copyright.
1
AU T O N O M O U S F O R E S T
M AC H I N E S PA S T, P R E S E N T
A N D F U T U R E
Thomas Hellström
1
, Pär Lärkeryd
2
, Tomas Nordfjell
3
and Ola Ringdahl
4
(1) Senior lecturer, Dept. of Computing Science, Umeå University, SE-901 87 Umeå,
Sweden. thomash@cs.umu.se
(2) CEO, Indexator AB, Lidvägen 2, SE-922 31 Vindeln, Sweden. par.larkeryd@indexator.se
(3) Professor, Dept. of Forest Resource Management, Swedish University of Agricultural
Sciences, SE-901 83 Umeå, Sweden. tomas.nordfjell@srh.slu.se
(4) Research engineer, Dept. of Computing Science, Umeå University, SE-901 87 Umeå,
Sweden. ringdahl@cs.umu.se
UMINF 08.06
ISSN-0348-0542
April 21, 2008
2
ABSTRACT
The feasibility of using autonomous forest vehicles (which can be regarded as logical
developments in the ongoing automation of forest machines), the systems that could be
applied in them, their potential advantages and their limitations (in the foreseeable future) are
considered here. The aims were to analyse: (1) the factors influencing the degree of
automation in logging; (2) the technical principles that can be applied to autonomous forest
machines, and (3) the feasibility of developing an autonomous path-tracking forest vehicle. A
class of such vehicles that are believed to have considerable commercial potential is
autonomous wood shuttles (forwarders). The degree of automation is influenced by increased
productivity, the machine operator as a bottle-neck, cost reduction, and environmental
aspects. Technical principles that can be applied to autonomous forest vehicles are satellite
navigation, laser odometry, wheel odometry, laser scanner and radar. The presented system
has demonstrated both possibilities and difficulties associated with autonomous forest
machines. It is in a field study shown that it is quite possible for them to learn and track a path
previously demonstrated by an operator with an accuracy of 0.1m on flat ground. A new path-
tracking algorithm has been developed to reduce deviations by utilizing the driver’s steering
commands.
Keywords: Forest technology, obstacle detection, path-tracking, robotic, system architecture.
3
1. INTRODUCTION
The aims of this study were to analyse: (1) the factors influencing the degree of automation in
logging; (2) the technical principles that can be applied to autonomous forest machines, and
(3) the feasibility of developing an autonomous path-tracking forest vehicle.
The first and second of the aims listed above were addressed by literature studies and
theoretical analysis, while the third aim was addressed in a field study.
The paper is organized as follows: Section 2 gives a historical background to automation in
forestry. Section 3 analyzes the major driving forces behind the urge to develop autonomous
forest machines while Section 4 summarizes the basic requirements for such systems. In
Section 5, a number of basic system design scenarios for semi-autonomous vehicles are
described. In Section 6, the experiences from a pilot project aiming at developing an
autonomous forest vehicle are discussed. The results from the field study are presented in
Section 7 and conclusions regarding state-of-the-art and future development in the area are
given in Section 8.
2. HISTORICAL BACKGROUND
For a long time forestry operations were largely performed manually, but the scope for further
improvements to the tools used, such as saws, axes and horse-drawn sledges, had become
very limited by around the year 1900 (Ekman 1908, Brown 1949, Sundberg 1978, Silversides
1997). However, the mechanisation of forestry started much later than the mechanisation of
agriculture (Sundberg 1978, Silversides 1997), with the introduction of the chain-saw for
harvesting and tractors for extraction. Nevertheless, there were some early examples of
technical forestry innovations. The first chain-saws light enough to be handled by just two
persons were developed in the USA and Sweden in the years 1916-17 (Sundberg 1978,
Silversides 1997). In USA, a single factory was producing chain-saws in 1938, six in 1942
and 30 in 1949 (Silversides 1997). The definitive breakthrough for chain-saws occurred in
around 1950, when they became sufficiently light to be handled by a single operator
(Sundberg 1978, Drushka & Konttinen 1997, Silversides 1997). In 1952, only 20% of the
pulp wood produced in eastern Canada was harvested with chain-saws, but by 1960 the
proportion had risen to almost 100% (Silversides 1997). Trends in the European countries
were similar, and a number of chain-saw factories were built in Sweden, and Germany.
However, chain-saws were still being used by fulltime professional operators at thinning
operations in Scandinavia until the beginning of the 1990s (Lidén 1995).
Many attempts were made in North America from the 1920s onwards to use tractors in
forestry (Brown 1949, Silversides 1997). An important step in mechanisation was that from
1925 tractors could be equipped with winches (Brown 1949). More than 8000 machines were
in use in Canadian forestry in 1950; three times more than in 1945 (Silversides 1997). Many
tracked vehicles for extraction were invented in the Soviet Union around 1950 and in North
America during the 1950s (Andersson 2004), were a skidder with articulated steering was
invented in 1959 (Silversides 1997). In addition, several machines for mechanised tree felling,
loading and extraction were invented during the 1950s, as well as machines for debranching
and cutting logs at road-side (Silversides 1997).
The large-scale mechanisation of extraction and harvesting operations occurred somewhat
later in the Scandinavian countries than in North America, although some early examples of
Scandinavian tractors for extraction were produced by the beginning of the 1930s (Drushka &
Konttinen 1997). Total global sales of forest machines in 1966 amounted to ca. 400 CTL
machines (generally used in Scandinavian forestry) and more than 5500 machines for stem- or
tree-cutting methods (generally used in North American or Soviet Union forestry) (Drushka &
4
Konttinen 1997). In 1957 the first Swedish tailor-made forest tractor was introduced, and
manufactured in large numbers (Östberg 1990). The introduction in 1959 of the first hydraulic
grapple loaders, mounted on tractors, was a highly important development for Scandinavian
forestry (Malmberg 1988). A forwarder with articulated steering, inspired by the American
“Blue ox” skidder and invented in 1962, was the next important Swedish breakthrough (Staaf
1988). Nevertheless, in the year 1960, the horse was still used for extracting more than 80%
of the total volume of logs extracted in Sweden, but by 1970 mechanised extraction was
totally dominant with 95% of the volume (Andersson 2004). Machines for debranching and
log cutting were introduced in the years 1966-67 (Nordansjö 1988) and machines for tree-
felling in 1972 (Östberg 1990). The whole CTL-harvesting operation was then mechanised.
Harvesters, which fell trees, debranch and cut logs, were invented in Sweden and Finland in
the years 1972-73 (Drushka & Konttinen 1997). In 1982 in professional forestry in Sweden,
51% of the volumes from final fellings were cut with a two-machine system (one for tree
felling and one for debranching and log cutting), 21% of the volume was cut with a harvester
and 24% was cut motor manually (using a chain-saw). The corresponding values five years
later were 25, 44 and 15%, respectively (Fryk et al. 1991).
The basic principles for CTL forest machines have remained the same since the 1990s.
Developments since then have been mainly focused on raising productivity, reducing costs
and optimising the division of the trees into logs.
The mechanisation of logging can be divided into six phases according to Silversides (1997),
in which the implements used were predominantly: hand tools and draught animals; various
combinations of hand tools; motor-manual tools; manually operated machines; machines that
automatically performed some repetitive work elements and machines that use feedback from
the process to control the next work element (e.g. a harvester with a bucking computer).
However, a further phase of mechanisation may occur when machines with no operators that
can work autonomously are developed (Gellerstedt et al. 1996). The machine presented by
Golob (1981) that required no operator for tree felling, debranching and laying stems in piles
can be seen as an early conceptual example of such a machine. The forces driving
mechanisation are a lack of workers, the aspiration to continue forestry operations year-round
and for more hours per day, and the desires to reduce costs, the amounts of hard physical
work involved and the lead-times between logging and industrial processing (Sundberg 1978,
Silversides 1997).
3. WHY AUTONOMOUS VEHICLES IN FORESTRY?
Autonomous vehicles have been considered, and tested, in various research and development
projects, in efforts to make forestry operations more efficient. The main identified benefits are
as follows.
Increases in productivity
Increases in productivity per unit time are perhaps the most important potential benefits of
automation: timber production will amount to 60 000 m
3
per year if a forest machine produces
20 m
3
per hour over an annual work-time of 3000 hours (with two drivers working in
shifts).To increase the annual work-time to more than 3000 hours using the same machines
more drivers would be required, and complex logistics with huge numbers of machine
movements between harvesting sites. However, there is another way to achieve the same
annual production levels. A year has 8760 hours, and if a machine can work autonomously it
might be possible for it to work efficiently over perhaps 6000 hours per year. The same
annual production level (60 000 m
3
) could then be delivered by a machine producing only 10
5
m
3
per hour. Furthermore, the cost per hour of an autonomous vehicle is not directly
influenced by salary costs, because it has no driver.
Elimination of the machine operator as a bottle-neck
Crane-speeds are currently limited essentially by the speeds their operators can handle, which
equate to average productivity levels of ca. 20 m
3
per hour, while the load capacity of
forwarders is currently limited solely by the weight the forest ground can support. A harvester
can fell, delimb and buck 60 – 100 trees per hour, and a large forwarder can carry a load of 18
tonnes. The machines are fast, but require an operator who constantly manoeuvres its crane
and harvester head and distinguishes differences in log quality classes both between and
within trees. This makes the work environment stressful, since many decisions must be taken
at high pace, and the operator often becomes a production bottle-neck. The operator can also
be the limiting factor for rates of loading and unloading forwarders. A possible way to
increase productivity is therefore to raise the level of automation and, if possible, use
autonomous forest machines.
Cost reductions
The salary of operators generally amounts to 30-40% of the hourly cost of a forest machine.
Thus, there would be substantial economic advantages if a machine could work
autonomously, or an operator could handle more than one machine at the same time.
Environmental aspects
The size and load capacities of forwarders have increased to raise productivity, and the risks
of damage to the ground have increased accordingly. Harvesters have also become larger.
This damage could be reduced, while maintaining overall productivity levels, by using an
autonomous harvesting system working 6000 productive hours per year but at only half the
hourly productivity rate of current forest machines. Thus, less advanced basic machines could
be used, e.g. harvesters processing 30-50 trees per hour with much slower crane movements,
and consequent reductions in mechanical stress, and forwarders with gentler crane
movements, slower driving speeds, and smaller loads. Generally, lower speeds require less
engine power. Thus, an autonomous machine can be lighter since its speeds and loads can be
lower, and the removal of the driver cabin alone can reduce the mass by ca. a tonne. It is also
easier to optimise the weight distribution of a forest machine without a large cabin. For
instance, it might be possible to place the crane of a forwarder in the middle of the machine,
and piles of wood on both its front and rear parts. With such changes a forwarder should be
able to carry a load of at least the same mass as itself. A 9-10 tonne forwarder would then be
able to carry a load of 10 tonnes, and the total mass would still not exceed 19-20 tonnes. Such
a machine would place considerably less stress on the forest ground and tires than current
forest machines. A lighter machine, with a higher load/mass ratio, would also consume less
fuel and generate less emission per m
3
handled.
4. WHAT IS REQUIRED FOR AUTONOMOUS WORK SYSTEMS IN
FORESTRY?
For the foreseeable future human beings will play a central role in the manoeuvring of forest
machines in harvesting operations, because so many complex factors need to be considered in
the work done by forest machines that full automation would be extremely difficult. The
issues that must be addressed include the following:
6
What trees should be harvested, and what are their optimal bucking lengths and
assortments, according to both economic and environmental considerations?
Where should the harvester be positioned, and what routes should be taken? These
decisions are based on ground conditions, obstacles in the terrain, judgements regarding
suitable driving routes in relation to the reach of the crane, the position and size of the
trees and the stability of the machine, which depends on the inclination of the ground,
slant of the tree, wind affecting the tree and environmental considerations.
In what direction should a tree be felled? The tree-felling has to be done without risks to
human beings, the machine itself or surrounding objects, for example power transmission
lines. The decision is based on the slant of the tree, the wind, the risk of damaging
remaining trees and the planned positions of small piles of saw-logs and pulpwood for
ease of extraction.
The transportation of wood out of the forest to the road-side requires an ability to
navigate, and thus the ability to follow a specific route. Navigation demands real time
knowledge with high precision about the surroundings as well as the position of the
machine in each moment.
The complex work elements and decisions described above have to be automated before an
autonomous forest machine can be constructed. This means that extensive research has to be
conducted within the three following main areas.
Support for decision-making
The driver of a harvester has to take many decisions (regarding, inter alia, where the machine
should be positioned, where small piles of logs should be placed and what trees should be
harvested), and systems that could facilitate the decision-making could be extremely useful.
The most complex decisions concern selective thinning, regarding which trees should be
harvested depending on the species and quality of the individual trees, and the properties of
the surrounding stand (density, tree sizes, species composition, etc.) (cf. Vestlund 2005). A
semi-autonomous way to solve this problem was presented by Kurabyashi & Asaman (2001),
in which trees selected for retention were identified by discs attached to them. A decision
support system for selective cleaning and thinning was developed by Vestlund et al. 2005, but
sensors that are more capable of detecting the trees and measuring the stand characteristics
that the algorithm relies on need to be developed before it can be fully implemented (Vestlund
2005).
Extraction of logs to the road-side does not require many difficult decisions to be taken. The
route is already roughly known because the harvester has already driven from the road-side to
the harvesting site, and manoeuvred at the site when harvesting trees. The harvester has also
placed small piles of saw-logs and pulp-wood beside the route it took within the harvesting
site. Therefore, before the extraction begins it should be possible to acquire information about
both routes and the positions of wood piles.
Automation of work elements
A number of repetitive work elements can be partly or fully automated, e.g. crane movements
during loading, unloading and sorting of assortments, positioning of the grapple or harvester
head, and placement of the crane in a suitable position when driving the machine.
Autonomous navigation in terrain
All autonomous work tasks in a forest require an ability to navigate. An early attempt to
develop an autonomous navigation system was presented by Kourtz (1996). To be successful
7
the vehicle must know were it is at all times, and how it should manoeuvre to follow the
decided route. Systems for detecting obstacles, human beings, animals, other machines and
buildings are also needed, as well as advanced transmission systems to avoid unnecessary
slippage.
5. POSSIBLE SCENARIOS
Due to the complexities of the problems involved, the current aim is not to fully automate the
felling process, but rather to develop various types of semi-autonomous systems in which man
is still involved, especially in decision-making. Three examples of possible system designs
are described below. Other possibilities have also been described; see for instance
Hallonborg (2003).
Remote supervision
This approach is based on a human remotely supervising a semi-autonomous system. When
necessary, the operator can take control of the system. Examples of this can be found in the
mining industry, for example LKAB have used unmanned loaders for several years that are
capable of autonomously navigating in mines. In forest applications, a process operator could
supervise such systems from his or her mobile office, and to some degree remotely control a
number of semi-autonomous harvesters and forwarders.
Semi-autonomous harvesters
In this scenario, a manned forwarder remotely controls one or more semi-autonomous
harvesters. An example of this is the prototype system Besten” [the Beast] (Bergkvist et al.
2006), which consists of an unmanned harvester remotely controlled from a manned
forwarder. Studies indicate that this could reduce the costs of final felling by more than 20
percent (Bergkvist et al. 2006).
Autonomous wood shuttles
This is a system that has not yet been tested in practice, but has been deemed in a study by
Hallonborg (2003) to have the best ability to compete with the current harvester system. In
this scenario, a manned harvester cuts the trees, but the logs are transported to the road by one
or more autonomous shuttles.
8
6. CURRENT RESEARCH TOWARDS DEVELOPING AN
AUTONOMOUS FOREST VEHICLE
During the last few years we have been addressing various problems that need to be solved
before viable autonomous forest machines can be constructed, and exploring systems that
could be applied in them, at the IFOR-centre, Umeå University. Algorithms for controlling
hydraulic cranes have been developed, which it is hoped will lead to semi-autonomous crane
functions for next-generation cranes of forest machines. The main aim for another project is to
establish a solid research platform for investigating in detail the feasibility, optimal features,
limitations and prospective systems of autonomous wood shuttles such as those described in
the previous section (Hellström et al. 2006, Ringdahl 2007). The project is based on a solution
in which an operator demonstrates a path by driving the vehicle manually along it once, either
by remote control or from the cabin (if still present). The computer in the shuttle records both
the vehicle’s pose and the operator’s steering commands. Thus, the system can learn the
adjustments to controls required to drive along the demonstrated path. However, due to
inaccuracies in signals from the position sensors in combination with unevenness of the
ground, deviations from the path can occur. Consequently, the problems involved in
autonomously tracking a demonstrated path are not easy to resolve, and interaction with the
environment is required for satisfactory solutions. The scenario in which an operator initially
demonstrates the path is of course a simplification and is not intended to be a final solution for
use in a commercial product. An alternative to manual demonstration of the path could be to
use information from a map. However, even in this case the ability to follow a predefined path
is essential. The chosen scenario should therefore also provide a suitable test platform for
further research relevant to these issues.
Figure 1 shows an overview of the system developed in the project to date. The computing
power is split between two computers connected by a Wireless Local Area Network (WLAN).
The primary computer is mounted in the autonomous shuttle and is responsible for hardware
interfacing and communication with the vehicle. It also contains low-level routines for
controlling velocity and steering angle, as well as processing sensor information. The
secondary computer is used by the operator to initiate and supervise the autonomous shuttle’s
operation.
The main technical challenges that need to be resolved to enable autonomous forest vehicles
are more refined techniques for positioning and obstacle detection. Solutions for these
problems are needed for the main task of path tracking. A few possible approaches for these
areas are presented below.
9
Actuators
Steering force
Throttle pedal
Brake
Sensors
For localization:
GPS/GLONASS
Gyro
For obstacle detection:
24 GHz radar
Laser scanner
Engine rpm
Steering angle
Mobile computer
Win XP Java
- Hardware interface
to sensors and actuators
- Low-level control loop
- Low-level data analysis and
occupancy grid
- Communication
Remote computer
Win XP Matlab
- User interface
- Path learning
- High-level control loop
for path tracking
- Data analysis routines
- Communication
WLAN
communication
DGPS base station
Figure 1. System overview of prototype machine. Two computers share the computing tasks;
one handles low-level tasks such as processing sensor information, while the other handles
higher level tasks, including path tracking, learning new paths, and user interfaces. The forest
machine shown is a concept of what a future autonomous shuttle could look like.
Positioning
For positioning, an accuracy of ±1 meter is regarded as both realistic and essential for safe
operation in a forest environment. This is the required accuracy for estimates of the real
position of the vehicle, so the positional information from the sensors must not deviate more
than a couple of decimetres from true values to ensure safe control of a large forest machine.
The following sensor techniques have been tested in the project:
Satellite navigation - The main sensor used for positioning is an advanced Real-Time
Kinematics Differential GPS (RTK DGPS) from Javad. With clear views of at least four or
five satellites, this system has an accuracy of about 2 centimetres. The receiver is capable of
receiving signals from both the American GPS system and the Russian GLONASS system.
While providing lower accuracy than GPS, GLONASS provides important backup, especially
at the high latitudes (64 degrees north) where the work is being conducted. The vehicle is
equipped with two receivers and two antennas, which also makes it possible to determine the
vehicle’s heading. The system also includes a stationary receiver that compensates for
common sources of errors in the satellite navigation system. This is done using the so-called
differential-GPS technique (DGPS), which sends correction signals by radio to the mobile
receivers. In the near future, the European Galileo system will hopefully contribute additional
positional information. However, all satellite navigation systems are sensitive to the reception
conditions, and in a forest environment the accuracy can easily deteriorate to 0.5 metres or
worse. In order to navigate even when the satellite navigation system is not providing
sufficient accuracy, techniques for combining several sensors have been developed. Using this
approach the accuracy can be increased sufficiently to autonomously navigate the vehicle for
10
a limited time, for example through a dense part of the forest. The sensing techniques used for
this purpose are briefly described below.
Laser odometry - Algorithms for a positioning technique called laser odometry have been
developed and evaluated in the project. A laser scanner mounted at the front of the vehicle
emits pulsed laser beams in a 180-degeee sweep and measures the distance to any object that
reflects the beam back to the scanner. This results in a picture of the nearest surroundings
consisting of 181 points. More technical details on the laser scanner are given below. To
calculate how the vehicle has moved between the times that two pictures were acquired, they
are compared to each other. In simplified terms, the algorithm that does this translates and
rotates one picture until as many as possible points in the two pictures coincide. This
translation and rotation correspond to the changes in the vehicle’s pose between the two
measurements. To obtain information on the vehicle’s position and heading, all movement
changes are summed. A drawback associated with this method is that many small errors
accumulate, aggregating to total errors that increase with time. This drawback also affects
many other localization techniques. Consequently, sufficient accuracy can only be maintained
for short periods of time. Poor accuracy has been obtained in initial tests of laser odometry in
a forest environment, but further tests are needed to determine how well this technique could
work in practice
.
Wheel odometry - A vehicle’s movements can be calculated from measurements of its
velocity and steering angles. A problem with this technique is that the vehicle’s wheels can
slip considerably, resulting in reduced accuracy. Another problem, related to the articulated
joint design, is that the motions of the front and rear parts of the vehicle relative to the ground
are uncertain. When the steering angle changes the two parts move differently, depending on
factors such as weight distribution and ground conditions, leading to the introduction of small,
cumulative errors in each step of the calculations when the machine is changing heading, and
thus drift similar to the drift affecting laser odometry, as described above. To improve wheel
odometry, neural networks have successfully been used in the project (Ringdahl 2007). By
training a neural network with velocity and steering angle data from the forest machine and
using the exact positions obtained from the satellite navigation system, neural networks are
able to learn the mathematical relationships between velocities/steering angles and changes in
pose. The trained network can then be used as position sensors that are considerably less
subject to drift than ordinary wheel odometry systems. In trials in a forest environment the
average time before the drift exceeded 1 metre was 13 seconds when a neural network was
used, compared to 3 seconds when uncompensated wheel odometry was used.
Gyro - Normally the satellite navigation system is used to determine the vehicle’s heading
and, as for positional data, GPS signals provide highly accurate directional accuracy under
normal circumstances. However, if the GPS antennas do not have clear views of sufficient
satellites, a gyro with an internal compass is used instead (although the compass is not used
since the magnetic material in a forest machine substantially affects the magnetic fields in and
around it). The gyro we have been using in tests to date is an AHRS400CC from Crossbow
Technology, based on MEMS-technology (Micro Electro-Mechanical Sensors). Instead of
moving parts, vibrating ceramic plates are used to sense the angular rate. By multiplying the
mean angular rate reported by the gyro in a given sampling period by its duration we can
obtain a good estimate of the vehicle’s change in heading during the sampling period. The
vehicle’s current heading is calculated by summing these changes. Like the values provided
by odometry-based methods for determining position, the values obtained here are subject to
drift over time. However, the gyro system is much more accurate than systems based on either
11
wheel odometry or laser odometry. Estimates of heading from the gyro can be used with
sufficient accuracy (±5 degrees) for movements lasting about 50 seconds.
Obstacle detection
Detecting obstacles in forest environments is extremely demanding and raises problems that
have not yet been satisfactorily resolved. In particular it is difficult to determine if a detected
object is a real obstacle, like a stone, or a traversable object like a bush. Rough terrain and
“negative obstacles” (e.g. holes in the ground) present further challenges.
In the project, information from a laser scanner and a radar sensor is being used to create and
update local maps of the environment. The resulting occupancy grid includes probabilities of
obstacles in a fine-meshed grid and is created by weighing and integrating a large number of
sensor readings
.
Laser scanner - An LMS 221 laser scanner supplied by SICK, which operates by measuring
the time of flight of laser light pulses, is used to detect obstacles in front of the forest
machine. A pulsed laser beam is emitted from the scanner, reflected back if it meets an
obstacle, and is then registered by the scanner’s receiver. The time between transmission and
reception of the pulse is directly proportional to the distance to the obstacle. The maximum
range at which the scanner can detect an obstacle depends on the reflectivity of the object; the
more reflective the object, the further away the scanner can detect it. A tree can be detected at
about 60 metres. To reduce the scanner’s sensitivity to rain or snow, the scanner takes several
consecutive scans in thea same direction. By comparing these scans, it is able to determine
whether there is a real obstacle at a spot from which it detected a signal or if the signal was
due to something temporary like a snow flake. The LMS 221 laser scanner has an accuracy of
±35 mm and is able to do a 180 degree scan in 13-53 ms, depending on the angular resolution.
Radar -. An advantage with radar is its lower sensitivity to bad weather, such as fog, rain, or
snow. The radar used in the project is manufactured by TYCO and is primarily used in the car
industry. It has no movable parts, but emits pulses from two antennas with different lobe-
characteristics. By comparing the relative strength of the radar echoes the distance and
bearing to several targets can be computed. The resolution is about 15 centimetres and the
radar unit can detect obstacles up to 30 metres away.
Path-tracking
The vehicle has to be able to answer autonomously the following three questions in order to
follow a route: Where am I? Where should I go? How do I get there? The first question is
answered with the help of positioning sensors and systems, an important component of which
is the satellite navigation system. Where the vehicle should go, and how to get there are
mainly defined by the operator who demonstrates the desired route. Both the final destination
and the route are defined in this way. Algorithms for path-tracking are used to provide the
ability to follow the learnt route. One of the simplest algorithms is named Follow the Carrot,
which means that the vehicle steers straight towards a point further along the route, with no
concern about the appearance of the route before that point (Barton, 2001). This is analogous
to a driver sitting in a cart pulled by a donkey and steering by dangling a carrot in the desired
direction in front of the donkey using a fishing-rod. The drawback of this, and most of the
other standard algorithms, is that vehicles have a tendency to take short cuts around curves,
which is inadvisable in a forest environment where trees and other obstacles are often situated
close to a defined route. As part of our research efforts, a new algorithm Follow the Past
(Hellström, Ringdahl 2005) has been developed. The idea is to utilize the driver’s steering
commands during a learning phase and compensate for any deviations from the route, which
12
may occur if the machine has avoided an obstacle or if the positioning system is not
sufficiently accurate. Follow the Past consists of three separate sub-functions:
1. Imitate the steering angles that the driver used during the learning phase.
2. Turn to travel in the same direction as during the learning phase
3. Turn towards the route if the machine is located beside it.
All of the sub-functions propose steering angles, which are then summed to obtain a value
that is used to steer the vehicle. The developed algorithm works well, and the vehicle follows
an intended route with good precision without taking short cuts around corners, provided that
there are no obstacles nearby. A module based on the algorithm VFH+ (Borenstein, Koren
1991) is responsible for avoiding obstacles and has a higher priority than the route-following
module. The steering angle is corrected if an obstacle is detected on the route. The vehicle
then waits for an intervention by an operator if too large a correction is needed to avoid
collision.
7. FIELD STUDY
The techniques for path-tracking, localization, and obstacle detection described above were
evaluated on a Valmet 830 forwarder equipped with a LMS221 laser scanner for obstacle
detection and a Javad Maxor RTK DGPS for estimating position and heading. To compensate
for the effects of the vehicle’s rolling and pitching on GPS positional data, an AHRS400 gyro
was used.
To assess the performance of the developed system in general and the path-tracking algorithm
Follow the Past in particular, a 160 metres long path was tracked four times while measuring
the distance to the reference path with the GPS. In addition, manual measurements were
obtained by marking the ground at the rear tire of the forest machine at intervals during each
run and then measuring the distance between the reference path and the new run with a
measuring tape. The tests were performed on flat ground to minimize the effect of vehicle roll
and pitch. The ground was covered by a thin layer of snow.
To test the autonomous vehicle’s ability to avoid obstacles, a loading pallet was placed
slightly to the left of the learnt path in one test, and slightly to the right of the path in another
test. To detect obstacles a laser scanner is used to generate pictures from which an occupancy
grid is derived, and the obstacle-avoidance algorithm VFH+ is used to modify the direction of
travel if any obstacles are detected along the planned path.
The average distance from the path in the four runs was 0.10 metres according to the GPS,
and 0.07 metres according to the manual measurements while the maximum errors were 0.35
metres and 0.4 metres, respectively (Table 1; Fig. 2). The differences in distances obtained by
the two measuring techniques are well within the margins of error, given the accuracy of the
GPS and the manual measuring procedure.
13
Table 1. Distances from the reference path presented as means (m) and standard deviations
(
σ
) for each run and for all measurements together. The values are presented separately for
the manual measurements (man) and the GPS measurements (gps). N is the number of
measurements in each run.
RUN
[
]
mm
man
[
]
m
man
σ
man
N
[
]
mm
gps
[
]
m
gps
σ
gps
N
1 0.09 0.09 30 0.10 0.09 548
2 0.09 0.08 27 0.10 0.09 590
3 0.06 0.05 29 0.10 0.09 593
4 0.07 0.06 26 0.10 0.09 647
average 0.07 0.07 - 0.10 0.09 -
The probability of path-tracking errors less than 23 centimetres is 90% (Figure 3). Errors
larger than 38 centimetres were never observed during any of the four test runs, in which a
total of 2378 measurements were obtained.
With the implemented obstacle avoidance algorithm VFH+, the vehicle is able to avoid
obstacles and subsequently return to the learnt path (Figure 4). The obstacles were detected
using a laser scanner and an occupancy grid.
-30 -20 -10 0 10 20
-35
-30
-25
-20
-15
-10
-5
0
5
[m]
[m]
Reference path
Run1
Run2
Run3
Run4
14
Figure 2. Comparison of a 160-metre long reference path and four autonomous runs with the
developed path-tracking algorithm Follow the Past. The data show that the runs coincide
almost completely.
Figure 3. Cumulative distribution function (CDF) for the path-tracking errors (distance from
the reference path), obtained using the GPS.
Figure 4. Obstacle avoidance. (Left) The obstacle is placed to the left of the centreline of the
vehicle. (Right) The obstacle is placed to the right of the centreline of the vehicle. The
vehicle’s starting point is at the upper left corner of the figure. The obstacles were detected
using a laser scanner and an occupancy grid.
8. DISCUSSION AND CONCLUSIONS
The presented system has demonstrated both possibilities and difficulties associated with
autonomous forest machines. It is shown that it is quite possible for them to learn and track a
path previously demonstrated by an operator. The overall performance was very good in all
0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4
0
10
20
30
40
50
60
70
80
90
100
Distance to reference path [m]
Cumulative Probalbility [%]
15
four tests. For the future, the field study should be repeated in ordinary forest terrain with
obstacles and slippery slopes in different directions, and under a tree canopy.
A new path-tracking algorithm has been developed to reduce deviations by utilizing the
driver’s steering commands. It would also be possible to use information from a map to define
a desired path, but further research is required before this becomes a realistic alternative to the
operator demonstrating a safe path through the forest.
To determine the vehicle’s position and heading, a highly accurate satellite navigation system
is used. The results from the field study confirm the centimetre accuracy of the GPS claimed
by the manufacturer. Although the costs of such systems will no doubt decline in the future,
there is a need to develop less expensive techniques for determining position and heading.
Another reason for developing such techniques is that the accuracy of satellite navigation
systems can deteriorate considerably when the GPS-signals are obstructed by obstacles such
as large trees. For these reasons we have developed algorithms for laser odometry, neural
networks to improve wheel odometry, and techniques for combining information provided by
several position and heading sensors. The laser odometry system is highly sensitive to
inaccurate readings, and tests in forest environments have shown that it is difficult to make it
more accurate than wheel odometry. The neural network is usually able to increase the time
that wheel odometry can be used before the errors grow too large. The gyro gives the most
accurate heading information after the satellite navigation system.
Detecting obstacles is crucial for an autonomous vehicle. This is quite difficult in a forest
environment because the uneven terrain gives many “false positive” readings, i.e. detecting
obstacles at times when the ground simply becomes visible to the sensors, for example just
before a steep incline. Distinguishing between an obstacle and something the machine can
simply drive over, e.g. a large stone versus a shrub, presents further challenges. Detecting
“negative obstacles”, e.g. a ditch or steep slope, is also a problem to consider. To detect
obstacles as reliably as possible, the system supports use of several different sensors, although
to date we have mainly used the laser scanner, which is able to detect obstacles in front of the
vehicle. To keep track of obstacles and reduce the number of false positive readings, an
occupancy grid based on Bayesian updating is used.
To avoid detected obstacles, the VFH+ algorithm is used. We have found that this works well
for avoiding obstacles, but performs less well when there are narrow passages to negotiate
with obstacles close to both sides of the vehicle
. The behaviour of the vehicle, in terms of
variables such as how close to an obstacle it will go, can be altered by changing parameters in
the VFH+ algorithm. Major efforts to develop systems for avoiding obstacles in rough terrain
are being made by various groups around the world (cf. Iagnemma & Boehler 2006.).
A crucial factor that will strongly influence if and when autonomous forest machines are
introduced in forestry is interest from machine manufacturers. Major efforts are required to
proceed from academic research to products with acceptable performance for the end users.
We estimate that this will take at least 10-20 years depending, of course, on the scale of
resources invested in such efforts by both academic institutions and the forest industry.
16
ACKNOWLEDGEMENTS
The study was financed by Kempe foundation, VINNOVA and SLU. Thanks to Sees Editing
Ltd for revising the English.
REFERENCES
Andersson, S. 2004. Skogsteknik förr och nu. The Swedish Society of Forest History.
Årsskrift 2004: 102-116. (In Swedish).
Anon 2007. Statistical Yearbook of Forestry. Sveriges officiella statistik, National Board of
Forestry, Jönköping, Sweden. p. 108, 121. (In Swedish with English summary).
Barton, M. J. 2001. Controller Development and Implementation for Path Planning and
Following in an Autonomous Urban Vehicle, PhD thesis, University of Sydney, Australia.
Bergkvist, I., Nordén, B & Lundström 2006, H. Bergkvist, I.; Nordén, B. & Lundström, H.
Innovative unmanned harvester system, Skogforsk Results No 2. Uppsala, Sweden.
Borenstein, J., Koren, Y. 1991, The Vector Field Histogram - Fast Obstacle Avoidance for
Mobile Robots, IEEE Transactions on Robotics and Automation 7(3):278-288.
Brown, N.C. 1949. Logging. The principles and methods of harvesting timber in the United
States and Canada. John Wiley & Sons, Inc., New York. Chapman & Hall, Limited, London.
Drushka, K. & Konttinen, H. 1997. Tracks in the Forest. The Evolution of logging machinery.
Timberjack group, Helsinki, Finland. 254 pp.
Ekman, W. 1908. Skogsteknisk handbok. C.E. Fritzes Bokförlags Aktiebolag.
Centraltryckeriet. Stockholm, Sweden. (In Swedish).
Fryk, J., Larsson, M., Myhrman, D. & Nordansjö, I. 1991. Forest Operations in Sweden.
Forskningsstiftelsen Skogsarbeten. Kista, Sweden. ISBN: 91 7614 076 8.
Gellerstedt, S., Asplund, C. & Wästerlund, I. 1996. Robotics with application to forestry.
Uppsatser och Resultat nr. 285. Department of Operational Efficiency, SLU, Garpenberg,
Sweden. ISSN: 0282-2377.
Golob, T.B. 1981. Worker and his tools. Seminar on Occupational Health & Safety and
Applied Ergonomics on Highly Mechanised Logging operations. FAO/ECE/ILO, Ottawa,
Canada.
Hallonborg U. 2003. Unmanned forestry machines can be competitive, Skogforsk Results No
4, Uppsala, Sweden
Hellström, T., Johansson T. & Ringdahl O. 2006. Development of an Autonomous Forest
Machine for Path Tracking, volume 25 of Springer Tracts in Advanced Robotics, pages 603-
614. Springer, Field and Service Robotics: results of the 5th international conference, 2006.
17
Hellström, T. & Ringdahl, O. 2005. Follow the Past: a path-tracking algorithm for
autonomous vehicles, Int. J. Vehicle Autonomous Systems, 4 (2-4):216–224.
Iagnemma, K. & Buehler, M. 2006. Journal of Robotic Systems, 2006, Volume 23, Issue 9,
Special Issue on the DARPA Grand Challenge. John Wiley and Sons Ltd. ISSN: 0741-2223.
Kourtz, P. 1996. Autonomous forestry robots for brushing and thinning in young conifer
stands: early Canadian experiences. In: Gellerstedt, S., Asplund, C. & Wästerlund, I. 1996.
(Eds.) Robotics with application to forestry. Uppsatser och Resultat nr. 285. Department of
Operational Efficiency, SLU, Garpenberg, Sweden. ISSN: 0282-2377.
Kurabyashi, D. & Asaman, H. 2001. Navigation method by distributed map management for
autonomous bush removal robot. In: Halme, A., Chatila, R. & Prassler, E. (Eds.) FSR2001
Proceedings of the 3rd International Conference on Field and Service Robotics, June 11-13,
2001, Finland. ISBN: 952-5183-13-0.
Lidén, E. 1995. Inquiries into harvesting systems, quantities, and machine ownership in
Swedish industrial forestry status 1985/86 and 1992/93 and predictions for 1997/98.
Uppsatser och resultat 273, Department of operational efficiency, SLU, Garpenberg, Sweden.
ISSN: 0282-2377.
Malmberg, C-E. 1988. När skogsbruket började mekanisera, In. Anon 1988. Skogsteknisk
forskning och utveckling i Sverige under 50 år. Redogörelse nr 6. Forskningsstiftelsen
Skogsarbeten, Kista, Sweden (In Swedish).
Nordansjö, I. 1988. Teknisk utveckling i skogsbruket 1938-1988, In. Anon 1988,
Skogsteknisk forskning och utveckling i Sverige under 50 år. Redogörelse nr 6.
Forskningsstiftelsen Skogsarbeten, Kista, Sweden. (In Swedish).
Ringdahl, O. 2007. Autonomous Ground Vehicles in Unstructured Forest Environment,
Licentiate thesis, Department of Computing Science, Umeå University, 2007. ISBN-978-91-
7264-373-4.
Silversides, C.R. 1997. Broadaxe to flying shear. The mechanization of forest harvesting east
of the Rockies. National museum of science and technology. Transformation series 6. Ottawa,
Canada. 174 pp
Staaf, A. 1988. Brunetten – en uppmärksammad slutprodukt från VSA, In. Anon 1988.
Skogsteknisk forskning och utveckling i Sverige under 50 år. Redogörelse nr 6.
Forskningsstiftelsen Skogsarbeten, Kista, Sweden. (In Swedish).
Sundberg, U. 1978. Teknik i skog. I: Skogshögskolan 150 år. Problem och idéer i svenskt
skogsbruk 1828-1978. Liber förlag. Stockholm Sweden. ISBN 91-7088-979-1. (In Swedish).
Vestlund, K. 2005. Aspects of Automation of Selective Cleaning. Acta Universitatis
Agriculturae Sueciae. Doctoral Thesis No. 2005:74. Faculty of Forest Sciences.
Vestlund, K. Nordfjell, T. & Eliasson, L. 2005. Comparison of Human and Computer-based
Selective Cleaning. Silva Fennica 39(4): 509-523.
Östberg, M. 1990. En smedjas förvandling - ÖSAs historia. Nyströms tryckeri. Bollnäs,
Sweden. (In Swedish).
... There is also a desire to increase productivity in an industry whose operations are still largely manual. The use of robotics for forestry is therefore being touted as a second mechanisation wave driven by safety concerns, productivity, lack of workforce, cost reductions, processing lead times and year round production increases [1] . Technological advancement in the field of harvesting robotics in New Zealand would also change the face of the forest industry significantly. ...
... Robotics has the potential to transform forestry and is widely expected to become mainstreamed across many primary industries. A " radical change in technology " towards robotics use for forest operations is expected within the next 15–20 years [1,2]. The majority of research being conducted in advanced robotics for forestry is concentrated on the technical feasibility of using robotics in difficult and dangerous work environments, and the ergonomics of such devices. ...
... The focus of much research is on the technology; the human factors; and the economic value created through enhanced productivity. However, just getting the technology to work is insufficient for mainstreaming such devices into the sector [1,3]. MacDonald & Clow [4] found that it was not technological innovation that drove forest harvesting in America, but a pressing need from contractors to meet production and economic goals. ...
Article
Harvesting New Zealand's production forests is challenged due to a growing proportion of the plantation forest being grown on steep slopes. Advances in robotics may aid forest operations to improve productivity and cost effectively manage the growth and harvesting of logs from such difficult terrain. Robotic devices are increasingly being used in primary industry and may be used more in the future of New Zealand forestry, as many silvicultural and logging tasks could be done by machines. The greatest market drivers for the introduction of robotics include the current shortage of skilled personnel willing to undertake forestry operations, and an increasing cost of regulatory compliance. This paper identifies areas of potential advantage for robotics in the forest sector; and begins the debate on the impact on forestry workers from the introduction of such devices. Semi-structured interviews were conducted with 23 New Zealand forestry staff involved in forest operations, to gain an understanding of their reaction to, and perceptions of, the potential use of robotics in forestry. Robotics was widely viewed as a natural progression of mechanisation for the industry, and for around a third of respondents, seen as essential in order to have an industry that remains competitive in future. Tele-operated devices could both reduce the safety risks associated with harvesting, and complement the existing skill set of forest crews. The greatest perceived concerns from robotics implementation include the impact on employment in small rural communities; the ability of robotic devices to cope with the difficult terrain of the New Zealand forest environment; and meeting economic considerations given tree and forest variability. There is, however, good potential for tele-operated devices to be introduced into forestry operations in New Zealand, and continuing dialogue with end users about and during the development of such devices will significantly smooth their introduction.
... To mitigate the problem, researchers have developed semi-autonomous modules employing Inverse Kinematics (IK) control for crane operation, such as those in Figure 1a and Figure 1b. Examples of such work can be found in [Westerberg, 2014;Ortiz Morales et al., 2014;Hyyti et al., 2018;Hellström et al., 2008]. Another common forestry task is thinning, a process wherein stewards selectively remove some trees to allow more space for others [Forestry Focus, 2018]. ...
... [Wooden et al., 2010] develop a navigation system for the Big Dog robot; it was tested in a forest, and it features a local planner based on a graph search A* algorithm. [Hellström et al., 2008] discusses different planning algorithms (A*, elastic bands, potential fields) for forwarder machines; however, no results are shown since it is a pre-study only. More examples of forest navigation using graph search algorithms to compute paths can be found in [Tanaka et al., 2017;Mowshowitz et al., 2018]. ...
Article
Full-text available
This paper presents a system for autonomously conducting precision harvesting missions using a legged harvester. Precision tree harvesting removes some trees selectively, while leaving neighboring trees intact. Our robot performs the challenging task of navigation and tree grabbing in a confined, GPS-denied forest environment. We propose strategies for mapping, localization, planning, and control and integrate them into a fully autonomous system. The mission starts with a human mapping the area of interest using a detachable, custom sensor module. Subsequently, a human expert selects the specific trees for harvesting. The sensor module is then mounted on the machine and used for localization within the created map. A planning algorithm searches for both an approach-pose and a path in a single path planning problem. We design a path-following controller exploiting the legged harvester’s capabilities for negotiating rough terrain. Upon reaching the approach-pose, the machine grabs a tree with a general-purpose gripper. Our system has been tested in both emulated and natural forest settings. To the best of our knowledge, ours is the first robot to demonstrate such a level of autonomy on a full-size, hydraulic machine operating in a realistic environment.
... To mitigate the problem, researchers have tried to develop semi-autonomous modules for the crane operation in modern machines such as ones shown in Fig. 1a and Fig. 1b. Examples of such work can be found in [Westerberg, 2014, Ortiz Morales et al., 2014, Hyyti et al., 2018, Hellström et al., 2008. ...
... [Mikhaylov and Lositskii, 2018] shows a very simplistic architecture without any validation. In [Hellström et al., 2008] and [Georgsson et al., 2005], a GPS based tracking approach is presented and validated on a forwarder machine outside of a forest environment. [Tominaga et al., 2018] show experiments on an All Terrain Vehicle (ATV) without an arm in a small scale environment using GPS with Real-time Kinematic (RTK) correction. ...
Preprint
This paper presents an integrated system for performing precision harvesting missions using a walking harvester. Our harvester performs the challenging task of autonomous navigation and tree grabbing in a confined, GPS denied forest environment. Strategies for mapping, localization, planning, and control are proposed and integrated into a fully autonomous system. The mission starts with a human or a mobile robot mapping the area of interest using a custom-made sensor module. Subsequently, a human expert or a data-supported algorithm selects the trees for harvesting. The sensor module is then mounted on the machine and used for localization within the given map. A planning algorithm searches for both an approach pose and a path in a single path planning problem. We design a path following controller leveraging the walking harvester's capabilities for negotiating rough terrain. Upon reaching the approach pose, the machine grabs a tree with a general-purpose gripper. This process repeats for all the trees selected by the operator (algorithm). Our system has been tested on a testing field with tree trunks and in a natural forest. To the best of our knowledge, this is the first time this level of autonomy has been shown on a full-size hydraulic machine operating in a realistic environment.
... Diesel is the most common source of energy in agricultural, construction and forestry MIMs. However, with the introduction of increasingly automated vehicles, the number of electric MIMs has been growing [46]. ...
Article
Full-text available
The effort to automate is present across all industries. It has an economic purpose but potential impacts go far beyond economics. Research has been carried out and a lot of investment has been made in automation in a variety of industries, as well as in agriculture and forestry, which resulted in efficient solutions for diverse applications. In fact, more solutions have emerged in the field of agriculture than in any other. This can be explained in economic terms, but also in light of the complex navigation required because of unstructured environments such as forests. This paper provides a comprehensive review of existing mobile platforms and presents a comparative study for an application in forest clearing. We evaluate the size, automation levels, traction, energy source, locomotion systems, sensors/actuators availability and tools that such an application must have to succeed in its function. Hence, it will be possible to evaluate the feasibility of retrofitting an existing platform into an electric unmanned ground vehicle for forest clearing or if it is easier to start development from scratch. The evaluation results reveal that an electric unmanned ground vehicle for forest clearing is currently unavailable in the market and that a new platform is needed. The performance requirements for such a platform are identified and proposed in the paper.
... When forest machines have acquired the ability to detect, identify, and locate objects in the forest environment, encountered terrain with classified and marked objects can allow exploration into new advanced human-machine interaction methods, such as the autonomous establishment of local maps based on detected objects as overlaid landmarks, thus having autonomous localization and navigation in the region, complete unmanned logging of trees with pose estimation and collection of logs, etc. Similar perspectives have also been proposed by some other researchers [35][36][37][38]. ...
Article
Full-text available
Research highlights: An automatic localization system for ground obstacles on harvested forest land based on existing mature hardware and software architecture has been successfully implemented. In the tested area, 98% of objects were successfully detected and could on average be positioned within 0.33 m from their true position in the full range 1–10 m from the camera sensor. Background and objectives: Forestry operations in forest environments are full of challenges; detection and localization of objects in complex forest terrains often require a lot of patience and energy from operators. Successful automatic real-time detection and localization of terrain objects not only can reduce the difficulty for operators but are essential for the automation of harvesting and logging tasks. We intend to implement a system prototype that can automatically locate ground obstacles on harvested forest land based on accessible hardware and common software infrastructure. Materials and Methods: An automatic object detection and localization system based on stereo camera sensing is described and evaluated in this paper. This demonstrated system detects and locates objects of interest automatically utilizing the YOLO (You Only Look Once) object detection algorithm and derivation of object positions in 3D space. System performance is evaluated by comparing the automatic detection results of the tests to manual labeling and positioning results. Results: Results show high reliability of the system for automatic detection and location of stumps and large stones and shows good potential for practical application. Overall, object detection on test tracks was 98% successful, and positional location errors were on average 0.33 m in the full range from 1–10 m from the camera sensor. Conclusions: The results indicate that object detection and localization can be used for better operator assessment of surroundings, as well as input to control machines and equipment for object avoidance or targeting.
... For greenhouse, a wide range of remote sensing studies are carried out nowadays to assess the platform Performance such as, vehicles design, architecture and accuracy. In fact, the requirements for remote-sensed vehicle have been designed and the specifications for behavior of navigation and operations have been defined in Hellström et al [5]. Their study showed that it is quite possible to learn and track a path previously demonstrated by an operator with an accuracy of 0.1m on flat ground. ...
Article
Full-text available
Pesticides is considered one of the most hazardous compounds that caused serious health implications to man and environment. However, their use is perquisite to guarantee a high yield especially , for greenhouse cucumber production. In fact, the process success depend on spraying coverage, rate and early detection of infection symptoms. In this study, a novel remote sensing approach for detecting Powdery Mildew symptoms in cucumber (Cu-cumis sativus) leaves has been developed. The experiment was conducted under greenhouse conditions. An unmanned vehicle platform used to carry the remote sensing sensors. Infected leaves were then analyzed using a pioneer image processing model. In this model, leaves were classified according to different feature especially, the reflect color. Image processing results were then assessed using ground reference data (lab analysis). The accuracy assessment of remotely-sensed data was ground reference data were comparable. Because changes in infected leaves associated with the imagery model data, we conclude that remotely-sensed data derived from the unmanned vehicle sensor data hold promise for detecting Powdery Mildew symptoms in cucumber leaves.
... Another important application of the tree positions is for accurate co-registration of multi-modal aerial and terrestrial LiDAR point clouds/images of forest scenes based on pairwise distances between trees within the scene (Polewski et al., 2019;Lee et al., 2016). Also, from a practical perspective, precise information about tree positions is crucial for the operation of autonomous logging machines (Hellström, 2008), which navigate through the forest and automatically harvest designated trees. Finally, the emerging technology for geo-location and navigation of autonomous vehicles in GPS-denied areas often relies on accurate tree positions as a robust terrain feature for orientation (Hussein et al., 2015). ...
Article
Full-text available
Airborne laser scanning (ALS) is an established tool for deriving various tree characteristics in forests. In some applications, an accurate pointwise estimate of the tree position is required. For dense data acquired by TLS or UAV-mounted scanners, this can be achieved by locating the stem, whose center coordinates are then used for deriving the planimetric tree position. However, in case of standard ALS data this is often not an option due to the low probability of obtaining stem hits in operational scenarios of forest mapping campaigns. This paper presents an alternative, indirect approach where the tree position is approximated as the center of a quadric surface which best represents the tree crown shape. The study targets coniferous trees due to their distinct crown shape which may be approximated by an elliptic paraboloid. It is assumed that individual tree point clusters are given and the task is to find the tree center for each cluster. We first consider the general problem of fitting an elliptic paraboloid with a known axis and an L1 residual norm error criterion, which is more robust to outliers compared to least-squares fitting. We formulate this problem as a quadratically constrained quadratic program (QCQP), and show how prior knowledge on the crown shape and center position can be incorporated. Next, a computationally simpler problem is considered where the paraboloid semiaxis lengths are constrained to be equal, and a corresponding linear program is constructed. Experiments on ALS datasets of forest plots from Bavaria, Germany and Oregon, USA reveal that a reduction in median tree position error of up to 20% can be attained compared to both least-squares fitting and other baseline techniques, resulting in an absolute error of ca. 22 cm on both datasets.
... Besides fire-fighting, advances in agricultural robotics provide good prospects for the development of autonomous brush clearing robots, because the technology involved relies heavily in harvest automation [19]. In fact, the EU has funded several projects in this area, such as VineRobot [20], proposing the development of an autonomous robot for precision viticulture. ...
Conference Paper
Full-text available
Europe has been affected by an alarming number of wildfires every year, ravaging nearly half a million hectares of forestry areas and resulting in an unacceptable amount of human losses. The year 2017 was one of the worst ever recorded, with devastating wildfires raging across the globe. Bearing these shocking facts in mind, this position paper aims to lay the foundations of crucial new upcoming research in the field of forestry robotics by presenting an overview of the SEMFIRE project. SEMFIRE proposes the development of a robotic system designed to reduce the accumulation of combustible material in forests, thus assisting in landscaping maintenance tasks for wildfire prevention. This paper describes the multi-robot system envisaged by SEMFIRE, combined with pervasive local positioning, multi-robot navigation and coordination in forests, and an innovative artificial perception architecture.
Article
Teleoperation of forestry machinery is a difficult problem. The difficulties arise because forestry machines are primarily used in unstructured and uncontrolled environments. However, improvements in technology are making implementation of teleoperation for forestry machines feasible with off-the-shelf computing and networking hardware. The state-of-the-art in teleoperation of forestry machinery is reviewed as well as teleoperation in similarly unstructured and uncontrolled environments such as mining and underwater. Haptic feedback in a general sense is also reviewed, as while haptic feedback has been implemented on some types of heavy machinery it has not yet been implemented on forestry machinery.
Conference Paper
Mechanization of forestry harvesting has significant and proven cost, productivity and safety benefits. However, safety concerns mean conventional mechanised harvesting cannot be used in steep terrain (>22° slope) in New Zealand. This means that manual harvesting must still be used in the most dangerous conditions. This paper outlines a project being run by the University of Canterbury in partnership with Scion Research and Future Forests Research to develop a teleoperated steep slope forestry harvester that is appropriate for use in the New Zealand environment. The challenges of the project include overcoming communication delay, latency and packet loss; ensuring stability and safety; presenting information to the operator in an appropriate way and ensuring the harvester stays stable and easily controllable.
Article
Full-text available
Eliasson, L. 2005. Comparison of human and computer-based selective cleaning. Silva Fennica 39(4): 509–523. In silvicultural tending operations like cleaning (pre-commercial thinning), the results are irreversible, so it is important for the decisions to be consistent with the aims for the stand. To enable operational automatic stem selections, a decision support system (DSS) is needed. A previously presented DSS seems to render acceptable cleaning results, but needs further analysis. The aims of the study were to compare the cleaning results of experienced cleaners and DSS simulations when "similar" instructions were given, and to assess the usefulness and robustness of the DSS. Twelve experienced cleaners were engaged to "clean" (mark main stems) six areas; each cleaner "cleaned" two areas. The DSS was used to generate two computer-based cleanings (simulations) of these areas. Four laymen also "cleaned" one of the areas following the DSS. The density results were significantly affected by the areas' location, whereas the proportions of deciduous stems and damaged stems were significantly affected by both the areas' location and method, i.e. manual "cleaning" and general or adjusted simulation. The study showed that the DSS can be adjusted so that the results are comparable with the cleaners' results. Thus, the DSS seems to be useful and flexible. The laymen's results were close to the results of the "general" simulation, implying that the DSS is robust and could be used as a training tool for inexperienced cleaners. The DSS was also acceptable on a single-tree level, as more than 80% of the main-stems selected in the simulations were also selected by at least one cleaner.
Article
Full-text available
A number of algorithms for path tracking are described in the robotics literature. Traditional algorithms, like Pure Pursuit and Follow the Carrot, use position information to compute steering commands that make a vehicle follow a pre-defined path approximately. These algorithms are well known to cut corners, since they do not explicitly take into account the actual curvature of the path. In this paper we present a novel algorithm that uses recorded steering commands to overcome this problem. The algorithm is constructed within the behavioural paradigm common in intelligent robotics and is divided into three separate behaviours, each responsible for one aspect of the path-tracking task. The algorithm is implemented both on a simulator for autonomous forest machines and a physical small-scale robot. The results are compared with the Pure Pursuit and the Follow the Carrot algorithms and show a significant improvement in performance.
Conference Paper
Full-text available
In many respects traditional automation in the forest-machine industry has reached an upper limit, since the driver already has to deal with an excess of information and take too many decisions at a very high pace. To further automation still, introduction of semi-autonomous and autonomous functions are expected and considered necessary. This paper describes an ongoing project along these ideas. We describe the development of the hardware and software of an unmanned shuttle that shifts timber from the area of felling to the main roads for further transportation. A new path-tracking algorithm is introduced, and demonstrated as being superior to standard techniques, such as Follow the Carrot and Pure Pursuit. To facilitate the research and development, a comprehensive software architecture for sensor and actuator interfacing is developed. Obstacle avoidance is accomplished by a new kind of radar, developed for and by the automotive industry. Localization is accomplished by combining data from a Real-Time Kinematic Differential GPS/GLONASS and odometry. Tests conducted on a simulator and a small-scale robot show promising results. Tests on the real forest machine are ongoing.
Article
Full-text available
A real-time obstacle avoidance method for mobile robots which has been developed and implemented is described. This method, named the vector field histogram (VFH), permits the detection of unknown obstacles and avoids collisions while simultaneously steering the mobile robot toward the target. The VFH method uses a two-dimensional Cartesian histogram grid as a world model. This world model is updated continuously with range data sampled by onboard range sensors. The VFH method subsequently uses a two-stage data-reduction process to compute the desired control commands for the vehicle. Experimental results from a mobile robot traversing densely cluttered obstacle courses in smooth and continuous motion and at an average speed of 0.6-0.7 m/s are shown. A comparison of the VFN method to earlier methods is given
Article
A combination and revision of the author's Logging-principles and practices in the United States and Canada, and Logging Logging-transportation Publicado en 1934 bajo el titulo: "Principles and Practicesin the United States". Reimpresión en 1961.
Article
Cleaning (pre-commercial thinning) is a silvicultural operation, primarily used to improve growing conditions of remaining trees in young stands (ca. 3 - 5 m of height). Cleaning costs are considered high in Sweden and the work is laborious. Selective cleaning with autonomous artificial agents (robots) may rationalise the work, but requires new knowledge. This thesis aims to analyse key issues regarding automation of cleaning; suggesting general solutions and focusing on automatic selection of main-stems. The essential requests put on cleaning robots are to render acceptable results and to be cost competitive. They must be safe and be able to operate independently and unattended for several hours in a dynamic and non-deterministic environment. Machine vision, radar, and laser scanners are promising techniques for obstacle avoidance, tree identification, and tool control. Horizontal laser scannings were made, demonstrating the possibility to find stems and make estimations regarding their height and diameter. Knowledge regarding stem selections was retrieved through qualitative interviews with persons performing cleaning. They consider similar attributes of trees, and these findings and current cleaning manuals were used in combination with a field inventory in the development of a decision support system (DSS). The DSS selects stems by the attributes species, position, diameter, and damage. It was used to run computer-based simulations in a variety of young forests. A general follow-up showed that the DSS produced acceptable results. The DSS was further evaluated by comparing its selections with those made by experienced cleaners, and by a test in which laymen performed cleanings following the system. The DSS seems to be useful and flexible, since it can be adjusted in accordance with the cleaners’ results. The laymen’s results implied that the DSS is robust and that it could be used as a training tool. Using the DSS in automatic, or semi-automatic, cleaning operations should be possible if and when selected attributes can be automatically perceived. A suitable base-machine and thorough research, regarding e.g. safety, obstacle avoidance, and target identification, is needed to develop competitive robots. However, using the DSS as a training-tool for inexperienced cleaners could be an interesting option as of today.
Navigation method by distributed map management for autonomous bush removal robot
  • D Kurabyashi
  • H Asaman
Kurabyashi, D. & Asaman, H. 2001. Navigation method by distributed map management for autonomous bush removal robot. In: Halme, A., Chatila, R. & Prassler, E. (Eds.) FSR2001 Proceedings of the 3rd International Conference on Field and Service Robotics, June 11-13, 2001, Finland. ISBN: 952-5183-13-0.
Autonomous forestry robots for brushing and thinning in young conifer stands: early Canadian experiences Robotics with application to forestry. Uppsatser och Resultat nr
  • P Kourtz
  • S Gellerstedt
  • C Asplund
  • I Wästerlund
Kourtz, P. 1996. Autonomous forestry robots for brushing and thinning in young conifer stands: early Canadian experiences. In: Gellerstedt, S., Asplund, C. & Wästerlund, I. 1996. (Eds.) Robotics with application to forestry. Uppsatser och Resultat nr. 285. Department of Operational Efficiency, SLU, Garpenberg, Sweden. ISSN: 0282-2377.